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TITLE OF THE INVENTION 



APPARATUS AND METHOD FOR CORRECTING SHAKE BY CONTROLLING 
SAMPLING TIMING OF SHAKE SIGNAL 

5 

BACKGROUND OF THE INVENTION 

The present invention relates to an image sensing 
apparatus comprising an electronic anti-shake system that 
10 corrects a shake by electrically extracting a sensed image 
on the basis of shake information of a camera and an image 
sensing method, and to a shake correction apparatus and 
method . 

Conventionally, image sensing apparatuses >such as 
15 video cameras and the like have a variety of automatic 

functions such as AE (auto exposure) , AF (auto focus) , and 
the like, and can sense and output a good image. 

Also, to compensate for a drop of sensed image quality 
resulting from a shake of an image sensing apparatus along 
20 with recent size reduction of video cameras and higher 

magnification of optical systems, various shake correction 
image sensing apparatuses that correct such camera shake have 
been proposed. 

Fig. 1 shows an example of the arrangement of a 
25 conventional image sensing apparatus with a shake correction 
function. 
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Referring to Fig. 1, this image sensing apparatus is 
composed of an image sensing unit and a camera shake 
correction unit. The image sensing unit {camera unit) has 
a lens 901, image sensing device 902, and signal processing 
5 circuit 903. The image sensing device 902 comprises a CCD 
or the like as a photoelectric conversion means, and converts 
an optical signal into an electrical signal. The signal 
processing circuit 903 converts the electrical signal output 
from the image sensing device 902 into a standard video signal 
10 such as an NTSC signal or the like, and has a video output 
terminal 904 from which the standard video output is 
obtained. 

Also, in Fig. 1, the camera shake correction unit 
comprises an angular velocity sensor 905 serving as a shake 

15 detection means, a DC cut filter 906, an amplifier 907, a 
computer 908 (to be abbreviated as COM hereinafter) serving 
as a correction amount calculation means, an electronic 
shutter 909 serving as an AE control means, a read controller 
910, and a timing generator 911. 

20 The angular velocity sensor 905 comprises, e.g., a 

vibration gyro attached to the image sensing apparatus main 
body, and detects any shake of the image sensing apparatus 
main body in two coordinate axes which are fixed with respect 
to the apparatus main body. That is, the output signal from 

25 the sensor 905 contains horizontal and vertical angular 

velocity signals. In the following description, the output 



signals from the sensor 905 in the two directions will be 
simply referred to as an angular velocity signal, and signal 
processing in the apparatus shown in Fig. 1 is done based 
on this angular velocity signal, for the sake of simplicity. 
5 The DC cut filter 906 cuts off DC components of the 

angular velocity signal output from the angular velocity 
sensor 905, and passes only AC components, i.e., shake 
components. Note that the DC cut filter 906 may use a 
high-pass filter (to be abbreviated as an HPF hereinafter) 

10 that cuts off signal components in a predetermined frequency 
band. The amplifier 907 appropriately amplifies the angular 
velocity signal output from the DC cut filter 906. 

The COM 908 has a microcomputer, and includes an A/D 
converter 908a, high-pass filter (HPF) 908b, integral 

15 circuit 908c, D/A converter 908d, and pan/tilt determination 
circuit 908e. 

The A/D converter 908a converts the angular velocity 
signal output from the amplifier 907 into a digital signal. 
The HPF 908b cuts off low-frequency components of the digital 

20 output of the A/D converter 908a, and has a function capable 
of varying its characteristics in an arbitrary frequency band. 
The integral circuit 908c integrates the output (angular 
velocity signal) from the HPF 908b to output an angular 
displacement signal, and has a function capable of varying 

25 its characteristics in an arbitrary frequency band. The DA 
converter 908d converts the integral signal output from the 



integral circuit 908c, i.e. , the angular displacement signal, 
into an analog signal. The pan/tilt determination circuit 
908e determines panning /tilting on the basis of a digital 
angular velocity signal 908f and an integral signal 908g 
5 (i.e., angular displacement signal) obtained by integrating 
the angular velocity signal, from which the low- frequency 
components have been cut, by the integral circuit 908c. The 
pan/tilt determination circuit 908e performs panning control 
(to be described later) on the basis of the levels of the 

10 input angular velocity signal 908f and angular displacement 
signal 908g. Also, the obtained angular displacement signal 
908g is used as a target value for shake correction in control 
done at a later time. 

The electronic shutter 909 especially controls the 

15 charge storage time period in the image sensing device 902 
in this embodiment. Although not shown, the electronic 
shutter 909 operates in accordance with the exposure state 
of the image sensing device 902 or user's operation. 

The shake correction control in Fig. 1 controls the 

20 read start position of the image sensing device 902 on the 
basis of the displacement amount signal 908g that represents 
shake amount. For this purpose, the read controller 910 
moves the read start position of the image sensing device 
902 in correspondence with the angular displacement signal 

25 908g. The read controller 910 also controls the storage time 



period of the image sensing device 902 by the electronic 
shutter 909 at the same time. 

The timing generator 911 generates drive pulses for 
signal storage or read of the image sensing device 902 on 
5 the basis of control information supplied from the read 
controller 910, and sends them to the image sensing device 
902. 

The operation of the pan/ tilt determination circuit 
903e in the COM 908 will be described in detail below. 

10 The determination circuit 908e receives the angular 

velocity signal 908f and angular displacement signal 908g, 
and determines that panning or tilting is underway in place 
of a shake, when it is determined that the angular velocity 
signal 908f is equal to or higher than a predetermined 

15 threshold value or when the angular velocity signal 908f is 
equal to or smaller than the predetermined threshold value 
but the angular displacement signal 908g is equal to or higher 
than a predetermined threshold value. If it is determined 
that panning or tilting is underway, the determination 

20 circuit 908e shifts the cutoff frequency range of the HPF 
908b to the higher -frequency side to change the 
characteristics so that the shake correction system does not 
respond to lower frequencies. Furthermore, the 
determination circuit 908e executes so-called "panning 

25 control" . In this panning control, the time constant of the 
integral characteristics of the integral circuit 908c is 



shifted in a direction to become shorter so as to move the 
central position of the image extraction position (1203 or 
1204 in Fig. 5; to be described later) by the read controller 
910 to the center of the entire area of the image sensing 
5 device 902, thereby bringing a value stored in the integral 
circuit 908c close to a reference value (a value that can 
be assured while no shake is detected) . During this panning 
control, the angular velocity signal 908f and angular 
displacement signal 908g are detected. When the 
10 panning/ tiling determination result changes to NO, i.e., 
when the user has finished panning or tilting, after the 
determination circuit 9 08e lowers the cutoff frequency to 
restore the original value and to broaden the shake 
correction range, it leaves the panning control. 
15 Pan determination will be explained below with 

reference to the flow chart in Fig. 2. Note that the 
processing shown in this flow chart repeats itself at 
predetermined timings . 

In step S1001, the angular velocity signal amplified 
20 by the amplifier 907 is converted from an analog amount into 
a digital value that can be processed inside the COM 908. 
In step S1002, the HPF 908b executes HPF processing using 
a cutoff frequency f c prepared in the previous processing. 
In step S1003, the integral circuit 908c integrates using 
25 a time constant x prepared in the previous processing. In 
step S1004, the D/A converter 908d converts the integral 
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result (i.e., the angular displacement signal 908g) in step 
S1003 into an analog amount, and outputs it. 

It is then checked in step S1005 if the angular velocity 
signal 908f is equal to or higher than a predetermined 
5 threshold value TH 1 . If the angular velocity signal is equal 
to or higher than the predetermined threshold value TH 2 , the 
value of the cutoff frequency f c to be used in the next HPF 
calculation is set to be higher by a predetermined value A x 
than the current value in step S1006. The shift operation 

10 of the cutoff frequency to the higher -frequency side sets 
the total attenuation factor of a signal in a low- frequency 
range to be higher than the current one. In step S1007, the 
time constant % used in the integral calculation is set to 
be shorter by a predetermined value than the current value, 

15 so that the angular displacement output 908g comes close to 
the reference value . 

On the other hand, if it is determined in step S1005 
that the angular velocity signal 908f is not equal to or higher 
than the predetermined threshold value TH^ it is checked in 

20 step S1008 if the integral value 908g is equal to or higher 
than a predetermined threshold value TH 2 . If the integral 
value 908g is equal to or higher than the predetermined 
threshold value TH 2 , the flow advances to step S1006; 
otherwise, the flow advances to step S1009. In step S1009, 

25 the value of the cutoff frequency f c to be used in the next 
HPF calculation is set to be lower by the predetermined value 



A 1 than the current value, so as to set the signal attenuation 
factor in the low- frequency range to be lower than the current 
one. In step S1010, the time constant t to be used in the 
integral calculation is set to be longer by a predetermined 
5 value than the current value to improve the integral effect, 
and this processing ends. 

With the above-mentioned control, when the shake 
velocity (angular velocity) value is large or when the 
integral value may be saturated, a higher cutoff frequency 
10 f c is set (step S1006) or a shorter integral time constant 
x is set (step S1007) , thus preventing the output from the 
integral circuit 908c from being saturated. As described 
above, since this integral value is D/A-converted, and is 
used in shake correction (to be described later) by the read 
15 controller 910, preventing the integral circuit 908 from 
being saturated leads to preventing the correction target 
value for shake correction from being saturated, realizing 
stable anti-shake control. 

The shake correction in this prior art will be briefly 
20 described below with reference to Fig. 3. This shake 

correction is implemented by changing the read position of 
image data form the image sensing device 902, that is, 
changing the image extraction position, in accordance with 
the output from the integral circuit 908c. 
25 Referring to Fig. 3, reference numeral 1100 denotes 

an entire image sensing area of the image sensing device 902 . 



Reference numeral 1101 denotes an extracted image area, which 
is extracted from the entire image sensing area 1100, and 
is actually converted into a standard video signal to be 
output as a video signal. Reference numeral 1106 denotes an 
5 object which is sensed by the photographer . In the following 
description, the outer sides of the extracted image area will 
be called an extraction frame. 

When the extracted image area 1101 is converted into 
a standard video signal and the converted signal is displayed, 

10 a video denoted by 1105 is obtained. That is, in Fig. 3, 
reference numeral 1105 denotes a video area of a monitor that 
reproduces a video signal; and 1106', an object (principal 
object) reproduced on the video area 1105 of the monitor. 
By outputting a portion obtained by excluding the peripheral 

15 portion from the entire image sensing area 1100 of the image 
sensing device 902 by sensed image extraction (to be 
described later) , the video area 1105 on the monitor can be 
reproduced. 

Furthermore, in Fig. 3, reference numeral 2000 denotes 
20 a change in image when the photographer who senses the object 
1106 has inadvertently swayed the image sensing apparatus 
in the lower left direction indicated by arrows 1102, 1102 ' , 
and 1102 " . When a shake in the lower left direction has taken 
place, the object 1106 moves in the upper right direction 
25 indicated by an arrow 1104 on the entire image sensing area 
1100. In this state, if extract ion is done using a frame area 
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1101' located at the same position as that of the 
above-mentioned extraction frame 1101, a video signal that 
represents an image in which the object 1106 has moved by 
a vector amount indicated by an arrow 1104 is generated. 
5 When the extraction frame is moved from the position 

1101' to a position 1101" using a displacement amount 1103 
(i.e., a shake correction target value) obtained based on 
the shake amount of the image sensing apparatus, and the image 
is extracted using this displaced extraction frame 1101", 
10 the same video as the video 1105 can be obtained. Using this 
principle, shake correction of an image is implemented. 

Displacement control of the extraction position of the 
image sensing area will be explained below with reference 
to Fig. 4. 

15 Referring to Fig. 4, reference numeral 12 00 denotes 

the entire pixel set of the image sensing device 902. 
Reference numeral 12 01 denotes a unit pixel which corresponds 
to one photoelectric conversion element. Based on 
electrical drive pulses generated by the timing generator 

20 911, storage and read are controlled in units of pixels. 

Reference numerals 1202 and 1203 denote extraction 
frames which are the same as the extraction frame 1101 shown 
in Fig. 3, i.e., those when no shake is produced. A case will 
be exemplified below wherein a video signal is extracted 

25 using the extraction frame 1202 shown in Fig. 4. 
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Initially, photoelectrically converted charge 
amounts are read out in turn from pixel "S" in a direction 
indicated by an arrow 1205 (i.e., horizontal direction). 
This read is started in synchronism with the synchronization 
5 period of the output video signal. Since pixel data 

corresponding to the synchronization period is not displayed, 
that pixel is read out at a rate higher than the data read 
rate of a pixel to be displayed, i.e. , the normal read rate. 
The first synchronization period continues to a position one 
10 pixel before pixel "A" in Fig. 4. 

During an actual video period after the end of the first 
synchronization period, charges in pixels A to F are read 
out as image information for one line of a video signal 
according to the normal read rate . 
15 Furthermore, during the horizontal synchronization 

period up to the next line, all pixels from a pixel next to 
pixel F to a pixel before pixel G are read out at a transfer 
rate higher than the normal read rate to prepare for a read 
of the next actual video period. A read from pixel G is then 
20 started as in that from pixels A to F. 

By controlling the read timings, as described above, 
all pixel data bounded by the extraction frame 12 02 can be 
selectively extracted from the entire image sensing area 1100 
of the image sensing device 902 and can be converted into 
25 a video signal. 



Shift of the extraction position when a sensed image 
has moved upon movement of the image sensing apparatus 
resulting from a shake will be explained below. When it is 
detected that the object has moved {= the image sensing 
apparatus has been shaken) by an amount indicated by an arrow 
1204, the extraction frame is changed from the position 1202 
to a position 1203 . By extracting an image using the changed 
extraction frame, a video free from any movement errors of 
the object can be obtained. 

In order to change the extraction position, when the 
read start position is shifted from pixel "A" to pixel "B" , 
an objective partial image can be selectively extracted from 
the image sensing area 1100 and can be converted into a video 
signal as in the read starting from pixel "A" . 

In practice, photoelectrically converted charge 
amounts are read out in turn from pixel "S" in the direction 
indicated by the arrow 1205 as in the read of the contents 
of the extraction frame 1202. This read is started within 
the synchronization period of the output video signal, and 
all pixels up to a pixel one pixel before pixel "B" are read 
out at a transfer rate higher than the normal read rate. 
During the actual video period, a read can start from pixel 
"B" . 

To restate, the displacement vector 1204 is generated 
by the read controller 910 on the basis of the displacement 
amount signal 908g. More specifically, the synchronization 
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period shown in Fig. 4 is determined by the read controller 
910 on the basis of the displacement amount signal 908g. in 
this fashion, in image extraction the peripheral image 
sensing area of the image sensing device 902 is partially 
5 read during the synchronization signal period that falls 
outside the actual video period by an amount corresponding 
to shake correction information, and only pixel data 
extracted in the actual video period are selectively read 
out, thus obtaining a video signal free from an image blur 

10 arising from the shake of the image sensing apparatus. 

As can be seen from Fig. 1, the correction amount 
(integral value 908g) is calculated based on the output from 
the angular velocity sensor 905 independently of 
storage/read of image data in the CCD 902. Since shake 

15 correction that has been explained in relation to Fig. 3 
extracts image data stored in the photoelectric conversion 
elements of the image sensing device 902 using an appropriate 
extraction frame, no problem is posed even when the shake 
of the camera main body is large and the value of the integral 

20 output 908g increases, unless the electronic shutter 909 
operates. This is because shake correction based on the 
output from the COM 908 controls the image extraction 
position and does not influence the charge storage time 
period. 

25 The reason why shake correction appropriately effects 

unless the electronic shutter 909 operates for exposure 
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amount control will be explained below with reference to 
Fig. 9. 

Fig. 5 is a timing chart showing movement of an image 
stored in the image sensing device 902 and the extraction 
5 timings along with an elapse of time. 

Referring to Fig. 5, reference numeral 1301 denotes 
a moving amount of an image on the surface of the image sensing 
device 902 upon occurrence of shake of the image sensing 
apparatus, in other words, shake of the image sensing 
10 apparatus itself. In the example shown in Fig. 5, the image 
sensing apparatus has swayed to first increase the image 
moving amount and then to decrease it. 

Referring to Fig. 5, reference numeral 1314 denotes 
a vertical synchronization signal (V synchronization signal) 
15 generated in the image sensing apparatus . More specifically, 
when this V synchronization signal is low level, known 
vertical synchronization control is done. The duration 
between two consecutive V synchronization signals 
corresponds to one field time period. More specifically, 
20 during the high-level period of the V synchronization signal, 
image data photoelectrically converted during this field 
(odd field) in the CCD 902 are stored parallel to a read of 
image data stored one field (even field) before. 

Reference numerals 1315, 1316, 1317, and 1318 denote 
25 the sampling timings of the A/D converter 908a; and 1319, 
1320, 1321, and 1322, the output timings of a shake correction 
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target value (i.e., displacement vector 1204) from the COM 
908 serving as the correction amount calculation means to 
the read controller 910 . Reference numerals 1323 , 1324, 1325, 
and 1326 denote timings at which the read controller 910 uses 
5 the correction target value output from the COM 908 in the 
read control of the image sensing device 902. Since the 
timings 1323, 1324, 1325, and 1326 match the low-level 
timings of the V synchronization signal, image extraction 
control is started from the synchronization period for a 

10 field (even field) next to the field (e.g., odd field) in 
which motion has been detected. 

Reference numeral 1306 in Fig. 5 denotes a change (a 
displacement per unit time period) in moving amount of an 
image during one field. When the electronic shutter 909 is 

15 inoperative, the whole period between the two vertical 
synchronization periods corresponds to the storage time 
period of the image sensing device 902. Hence, the change 
1306 represents the displacement of an image on the surface 
of the image sensing device 902 during the storage time period 

20 in one field. When the image displacement amount 1306 is 
integrated across the synchronization period (the period 
between the two V synchronization signals) , the integral 
value indicates the barycentric position of an image during 
a unit storage period. Assume that the barycentric positions 

25 of displacement amounts 13 06, 1307, 1308, and 13 09 have been 
detected at positions 1310, 1311, 1312, and 1313. The 
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barycentric positions 1310, 1311, 1312, and 1313 of an image 
assume a value close to a reference value 1327 indicated by 
the broken line as long as the maximum value of the slope 
of the displacement amount 13 01 is small to some extent, 
5 although they vary depending on the slopes and curvatures 
of the image displacement amounts 1306, 1307, 1308, and 1309 
per unit time period. In other words, while the electronic 
shutter is inoperative, the differences between the 
reference value 1327 and the values of the barycentric 
10 positions 1310, 1311, 1312, and 1313 as the integral values 
of the displacement amounts 1306, 1307, 1308, and 1309 become 
small . 

The central time of one period of the V synchronization 
signal (i.e., central times 1302, 1303, 1304, and 1305 of 

15 video periods) is set as the sampling timing of the angular 
displacement signal (the output from the D/A converter 908d) 
used in shake correction. This timing is indicated by 
"sampling timings" 1315, 1316, 1317, and 1318 in Fig. 5. 
Unless the electronic shutter operates, since the CCD 902 

20 records the displacements 1306, 1307, 1308, and 1309 for one 
frame period, the central time positions of the displacement 
amounts 1306, 1307, 1308, and 1309 nearly match the sampling 
timings 1315, 1316, 1317, and 1318. Since the read control 
of the image sensing device 902 is done based on such timing, 

2 5 the read controller 910 executes shake correction control 
to center on the image stored at the sampling timing 1315. 
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When the electronic shutter is inoperative, a video 
signal stored during the period of the image displacement 
amount 1306, 13 07, 13 08, or 1309 on the surface of the image 
sensing device 902 for the storage time period in one field 
5 is output from the image sensing device 902 while the next 
field is being stored. If the previously determined 
correction target value data is used at the time of this read, 
no time mismatch occurs between the shake which is being 
stored and the time period required until the correction 

10 target value. 

Furthermore, in Fig. 5, reference numeral 1327 denotes 
the reference value (= center at the time of correction, 
correction center) upon correction, and control is done so 
that the integral value of an image stored at the sampling 

15 timing 1315, 1316, 1317, or 1318 of the shake information 
matches this reference value 1327. 

In this way, since the shake information sampling point 
is set at the center 13 02, 1303, 1304, or 1305 of the 
synchronization period, the timing the value of the 

20 displacement amount 1306, 1307, 1308, or 1309 matches the 
reference value 1327, i.e., the time of the intersection 
between the displacement amount curve 13 06, 13 07, 13 08, or 
1309 and line 1310, 1311, 1312, or 1313 is set at a point 
in the neighborhood of the shake center of an image during 

25 the storage time period of the image sensing device 902, thus 
achieving shake correction by extraction. 
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In the system for correcting (or compensating for) an 
image blur shown in Figs. 1 to 5, since the timing of 
determination and correction of the shake correction amount 
based on shake correction information is reached once per 
5 read period of the image sensing device 902, detection of 
shake information and calculation of the correction target 
value used in shake correction are made once per read. 

More specifically, as has been explained with 
reference to Fig. 5, the shake information (angular 

10 velocity) is sampled once per synchronization period (one 
field period) at the central time 1315, 1316, 1317, or 1318, 
and the correction target value to be output based on the 
sampling data is formed once per synchronization period for 
one field, as indicated by 1319 to 1322. Of course, the read 

15 timing control of the image sensing device 902 is also 

determined at the beginning of the vertical synchronization 
period and remains unchanged until the next timing. 

In this conventional image sensing apparatus, 
detection of the image blur amount and calculation of the 

20 target value of a correction control variable are made at 
nearly the central time (1315 to 1318) of the synchronization 
period. In such image sensing apparatus, the electronic 
shutter 9 09 operates for the purpose of controlling the 
exposure amount, temporarily resets charges to zero during 

25 the storage time period of the image sensing device 902, and 
restarts storage, thus controlling the storage time period 
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of the image sensing device 902 . When the electronic shutter 
is operated, the barycentric position of an image during the 
actual storage time period and the reference position upon 
correction may have a large difference unlike in the case 
5 described with reference to Fig. 5. 

Why such large difference is produced will be explained 
below with reference to the timing chart shown in Fig. 6. 

Fig. 6 shows the movement of an image stored in the 
image sensing device 902 and the extraction timings along 

10 with an elapse of time, as in Fig. 5. 

Referring to Fig. 6, reference numeral 13 01 denotes 
the moving amount of an image on the surface of the image 
sensing device 902 as in Fig. 5, in other words, the shake 
of the image sensing apparatus itself. 

15 Also, points 1340, 1341, 1342, and 1343 respectively 

indicate the refresh timings at which the charges on the image 
sensing device 902 are reset . In the example shown in Fig . 6, 
such timing is set at nearly the center in one field, i.e. , 
the refresh operation continues until a timing (timings 13 40, 

20 1341, 1342, and 1343) near the central time of one field period . 
Hence, if charges are reset at that timing, the electronic 
shutter speed assumes a value half the shutter speed in normal 
storage (Fig. 5) . At this time, time periods indicated by 
solid curves 1344, 1345, 1346, and 1347 indicate movements 

25 of an image effectively stored as a sensed image in the image 
sensing device 902. 
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Reference numeral 1314 denotes a vertical 
synchronization signal generated in the image sensing 
apparatus as in Fig. 5. Reference numeral 1328 denotes a 
change in moving amount of the image effectively stored as 
5 the sensed image during one field, i.e., the displacement 
amount per unit time period. Reference numerals 1328, 1329, 
133 0, and 1331 denote displacements of an image on the surface 
of the image sensing device 902 during the effective storage 
time periods for one field. These displacements continue for 

10 periods nearly half the image displacement amounts 1306 , 1307 , 
1308, and 1309 described above with reference to Fig. 5, and 
account for roughly half the entire displacement amounts. 

When central times 1302 to 1305 between the 
synchronization periods of the synchronization signal 1314 

15 are used as the sampling timings of an angular displacement 
signal used in shake correction as in the description of the 
prior art, the storage start time of each of the displacement 
amounts 132 8 to 1331 per unit time period is set as a 
correction point upon image extraction, and shake correction 

20 control is done based on the displacement amount at that 
timing to locate an image stored at the sampling timing at 
the correction center at its read timing from the image 
sensing device 902 . 

Reference numeral 1327 denotes a reference position 

25 upon correction, and control is made to locate an image stored 
at the timing 13 02 as a sampling point on this reference 
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position 1327. Extraction control based on displacement 
amounts 1329 to 1331 per unit time period is similarly made . 

A line 1332 indicates the integral value of the 
displacement amount 1328 per unit time period, i.e., the 
5 barycentric position of an image during a unit storage time 
period as in the above description. As can be seen from the 
barycentric position 1332 of the image, the difference from 
the reference position 1327 upon correction becomes larger 
than that in the prior art described above with reference 
10 to Fig. 5. The same applies to barycentric positions 1333 
to 1335. 

When storage & read control of the image sensing device 
902 by the electronic shutter operation is made, the target 
correction reference position separates from the actual 
15 image barycentric position upon shake correction, and a video 
cannot be obtained with a sufficient anti-shake effect. 

Furthermore, as the storage time period becomes 
shorter in relation to the electronic shutter operation, this 
difference becomes larger. Hence, the problem that the 
20 correction reference position separates from the image 
barycentric position cannot be ignored. 

The first problem in the prior art has been explained. 
As the second problem in the prior art, correction 
errors are produced in shake correction due to errors in the 
25 response characteristics of the shake detection means with 
respect to shake frequency. More specifically, such 
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correction errors are produced when the response 
characteristics of an angular velocity sensor such as a gyro 
sensor or the like used as shake detection means with respect 
to frequency worsens as the frequency becomes higher. 
5 Fig. 7A shows the typical frequency response 

characteristics of an angular velocity sensor. In Fig. 7A, 
the abscissa plots the frequency ranging from about 1 Hz to 
20 Hz , which is considered as the camera shake frequency range 
of an image sensing apparatus. The ordinate plots the phase 

10 characteristics, which represent a lead or delay of the 

output from the angular velocity sensor with respect to the 
actual shake. 

When the shake frequency applied is low, the gyro 
sensor 905 exhibits characteristics indicated by a curve 292 

15 in Fig. 7A, which are free from any phase delay or lead. As 
the frequency applied to the sensor becomes higher, the 
response characteristics of the sensor 905 show a phase 
delay. 

A gyro sensor which is popularly used, e.g., a 
20 vibration gyro sensor produces a delay around 10 deg at 2 0 
Hz . 

Since this delay amount of the sensor output as the 
shake detection means finally appears as correction errors 
upon shake correction, if the delay amount of the response 
25 characteristics of the shake detection means increases, the 



- 22 - 



correction performance of shake correction (anti-shake rate) 
deteriorates . 

The second problem resulting from a response delay 
unavoidable in a shake detection sensor such as a gyro sensor 
5 or the like has been explained. 

The first and second problems occur when the angular 
sensor signal is sampled once per field period. 

A problem {third problem) that occurs in a prior art 
which samples a sensor signal a plurality of number of times 
10 within one field period will be explained below. 

In a conventional image sensing apparatus with a camera 
shake prevention function, an angular velocity sensor such 
as a gyro or the like is used to detect a shake signal as 
in the above-mentioned prior art, and the output from this 
15 sensor is input via an A/D converter. At this time, in order 
to improve the precision of data output from the sensor and 
to prevent noise, a sensor output is sampled a plurality of 
number of times within one field period, the obtained outputs 
are A/D-converted into a plurality of digital data, and the 
20 digital data are integrated. 

Since the hardware arrangement of this conventional 
multi-sampling image sensing apparatus is substantially the 
same as that shown in Fig. 1, Fig. 1 will be quoted. 

Fig. 7B is a timing chart for explaining the "sampling 
25 timings" of an angular velocity sensor 905 used in this 
conventional multi-sampling image sensing apparatus, the 



integral value calculation timings of an integral circuit 
908c, and the "correction timings" at which shake correction 
is done based on the obtained integral value. 

Referring to Fig. 7B, reference numerals 801 to 803 
5 denote vertical synchronization signals; and 1001 to 1008, 
sampling timings, i.e. , the conversion timings of an angular 
velocity signal obtained from the angular velocity sensor 
905 into a digital amount by an A/D converter 908a. These 
sampling timings have an appropriate phase relationship with 

10 the vertical synchronization signals 801 to 803, and 

intervals between neighboring timings are equal to each other, 
as shown in Fig. 7B. 

In the conventional multi -sampling image sensing 
apparatus, angular velocity information sampled at each of 

15 the timings 1001 to 1008 by the A/D converter 908a is 

integrated by the integral circuit 908c at each of timings 
1101 to 1108. In the example shown in Fig. 7B, integral 
results are obtained at timings 1104 and 1108. A read 
controller 910 receives these integral results (shake 

20 correction target values) at timings 1301 and 1302 to execute 
camera shake correction. 

However, in this conventional multi -sampling image 
sensing apparatus, when shake correction control is 
continuously done at the above-mentioned control timings, 

2 5 since the shake correction target values are calculated at 



fixed timings having equal time intervals, the use efficiency 

of a COM is poor. 

More specifically, as shown in Fig. 7B, shake 

information is sampled at the sampling timings 1001 to 1008, 
5 and a correction amount calculation is started at timings 

1101 to 1108 in correspondence with the sampling timings. 

These calculation time periods are indicated by processing 

timings 12 01 to 12 08 in the COM. In addition, the calculation 

time periods required for the read controller 910 to 
10 calculate extraction points after correction data is 

determined during the synchronization period are indicated 

by 1401 and 1402. 

Shake information sampling can be done by executing 

interrupt processing using an internal timer of the COM with 
15 reference to vertical synchronization signals, and the time 

period required for such sampling is very shorter than those 

required for other calculations and the like. The correction 

amount is discretely calculated in synchronism with the 

sampling timings of the angular velocity information, and 
20 the use efficiency of the COM itself is poor. Such idle state 

of the COM frequently occurs if a large number of times of 

sampling of shake information is set. 

More specifically, in case of, e.g., a standard video 

signal such as an NTSC signal or the like, sampling must be 
25 done around five to 10 times per field. For example, when 

a shake signal (angular velocity signal) is sampled 10 times 



per field, if about 16.7 ms as one field time period are 
equally divided into 10 periods, one sampling period is 
around 1 . 67 ms . The time period (duration 1201 ) required for 
calculations made in the COM falls within the range from about 
5 0.3 to 0.8 ms although it largely depends on the 

specifications of the computer used. Hence, the ratio of the 
running time period of the computer to the period = 1 . 67 ms 
between neighboring sampling timings falls within the range 
from about 18% to 48%, and the remaining time period which 

10 accounts for more than 50% of the whole time is an idle period. 

Even when this idle period is used for another 
application, if that application requires continuous 
processing, such idle period is not suitable for the 
application since one field has already been divided into 

15 a plurality of periods. If calculation processing such as 
auto-focus control that occupies a continuous time period 
and has higher priority is done, the correction amount 
calculation timing cannot be completed before the next 
sampling timing, and consequently , one sampling data is lost, 

20 i.e., effective correction data cannot be obtained. 

SUMMARY OF THE INVENTION 

The present invention aims at solving the first problem, 
25 and has as its object to realize an image sensing apparatus 
and shake correction apparatus, which can prevent a drop of 
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anti -shake effect resulting from a difference between the 
shake detection information sampling timing and shake 
correction timing, and can always obtain a high anti-shake 
effect independently of changes in image sensing condition, 
5 exposure condition, and the like such as a change in storage 
time period and the like. 

According to the invention proposed to solve the first 
problem, there is provided an image sensing apparatus for 
electronically applying shake correction to sensed image 
10 data, and output ting corrected image data, comprising: 
shake detection means for detecting a shake; 
sampling means capable of sampling shake information 
detected by the shake detection means at a plurality of 
sampling timings within one field period of the image sensing 
1 5 apparatus ; 

selection means for selecting a shake information 
signal at one of the plurality of sampling timings, which 
corresponds to a drive condition of image sensing means at 
the time of image sensing; 
20 correction control variable calculation means for 

calculating a shake correction control variable used in the 
shake correction by a predetermined calculation of the shake 
information signal selected by the selection means; and 

correction means for applying the shake correction to 
25 the sensed image data in accordance with the obtained shake 
correction control variable. 



According to this image sensing apparatus, since the 
sampling timing is set in correspondence with the drive 
condition at the image sensing timing of the image sensing 
means, the difference between the shake detection 
5 information sampling timing and shake correction timing can 
be appropriately removed. 

The above object can also be achieved by an image 
sensing apparatus comprising: 

shake detection means for detecting a shake; 
10 sampling means for sampling shake information detected 

by the shake detection means at a predetermined timing ; 

correction control variable calculation means for 
converting the shake information sampled by the sampling 
means into a shake correction control variable by a 
15 calculation; 

read control means for controlling a read timing of 
an image sensing device on the basis of a calculation result 
of the correction control variable calculation means; and 

sampling timing control means for varying a sampling 
20 timing of the sampling means in accordance with a drive 
condition of the image sensing device. 

According to a preferred aspect of the present 
invention, an operation phase of the sampling means is 
variable within a sampling interval. 
25 The sampling timing preferably corresponds to nearly 

the central time during the storage time period of the image 
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sensing means. Since the storage time period changes 
depending on the drive condition set in the image sensing 
means, the difference between the shake detection 
inf ormat ion sampling timing and shake correction timing can 
5 be appropriately removed. 

According to a preferred aspect of the present 
invention, the correction means sets an image data extraction 
position of a temporary storage memory in the image sensing 
device that stores an image signal in correspondence with 
10 the shake correction control variable calculated by the 
correction control variable calculation means, and outputs 
image data read out from the extraction position as 
shake-corrected sensed image data. 

The sampling timing can be set by various methods . For 
15 example, shake information sampled at a plurality of sampling 
timings via an A/D converter may be integrated, and one of 
integral results, which is suitable for the drive condition, 
may be selected. 

Also, the sampling timing suitable for the drive 
20 condition may be set in the A/D converter. 

An image sensing apparatus according to the present 
invention proposed to solve the second problem, comprises : 
shake detection means for detecting a shake ; 
sampling means for sampling shake information detected 
25 by the shake detection means at a predetermined timing; 
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correction control variable calculation means for 
converting the shake information sampled by the sampling 
means into a shake correction control variable by a 
calculation ; 

5 read control means for controlling a read timing of 

an image sensing device on the basis of a calculation result 
of the correction control variable calculation means; 

frequency detection means for detecting a frequency 
from the shake information obtained by the shake detection 
1 0 means ; and 

sampling timing control means for varying a sampling 
timing of the sampling means in correspondence with the 
frequency detected by the frequency detection means. 

Also, the second problem can also be solved by a shake 
15 correction apparatus comprising: 

shake detection means for detecting a shake; 
sampling means for sampling shake information detected 
by the shake detection means at a predetermined timing; 

correction control variable calculation means for 
20 converting the shake information sampled by the sampling 
means into a shake correction control variable by a 
calculation; 

read control means for controlling a read timing of 
an image sensing device on the basis of a calculation result 
25 of the correction control variable calculation means; 



frequency detection means for detecting a frequency 
from the shake information obtained by the shake detection 
means ; and 

sampling timing control means for varying a sampling 
5 timing of the sampling means in accordance with the frequency 
obtained by the frequency detection means . 

The present invention proposed to solve the third 
problem has as its object to provide an image sensing method 
and apparatus which can implement shake correction, and 
10 allows a calculation means such as a microcomputer or the 
like to efficiently execute processing other than shake 
correction. 

In order to achieve this object, an image sensing 
method according to the present invention, comprises: 
15 image sensing method comprising: 

the shake detection step of detecting a shake; 
the sampling step of sampling shake information 
detected in the shake detection step at a plurality of 
predetermined even timings during one video period; 
20 the shake correction control variable calculation step 

of converting the shake information sampled in the sampling 
step into a shake correction control variable by calculations 
at uneven timings in correspondence with the number of times 
of sampling; and 
25 the shake correction step of correcting a shake of an 

image sensing apparatus main body on the basis of a 



calculation result in the shake correction control variable 
calculation step. 

The above object can also be achieved by an image 
sensing apparatus comprising: 
5 shake detection means for detecting a shake; 

sampling means for sampling shake information detected 
by the shake detection means at a plurality of predetermined 
even timings during one video period; 

shake correction control variable calculation means 
10 for converting the shake information sampled by the sampling 
means into a shake correction control variable by 
calculations at uneven timings in correspondence with the 
number of times of sampling; and 

shake correction means for correcting a shake of an 
15 image sensing apparatus main body on the basis of a 

calculation result of the shake correction control variable 
calculation means . 

Furthermore, the above object can be achieved by an 
storage medium that stores a control program for controlling 
20 an image sensing apparatus, the control program having 
control modules of the steps of: 

detecting a shake of an image sensing apparatus main 

body; 

sampling the detected shake information at a plurality 
25 of predetermined even timings during one video period; 



converting the sampled shake information into a shake 
correction control variable by calculation at uneven timings 
in correspondence with the number of times of sampling; and 

correcting the shake of the image sensing apparatus 
5 main body on the basis of a calculation result of the shake 
correction control variable. 

The above objects may be achieved in combination with 
each other. However, such combinations will be apparent from 
the appended claims that describe them. 

10 

BRIEF DESCRIPTION OF THE DRAWINGS 



Fig. 1 is a block diagram showing the arrangement of 
a conventional image sensing apparatus; 
15 Fig. 2 is a flow chart showing pan determination 

sequence of a shake correction means in the conventional 
image sensing apparatus ; 

Fig. 3 is a view for explaining the outline of the shake 
correction means in the conventional image sensing 
20 apparatus ; 

Fig. 4 is a view for explaining extraction of a stored 
image by the shake correction means in the conventional image 
sensing apparatus; 

Fig. 5 is a timing chart for explaining operations from 
25 storage of an image sensing device until correction in the 
conventional image sensing apparatus; 



Fig. 6 is a timing chart for explaining operations from 
storage of an image sensing device until correction upon 
operation of an electronic shutter in the conventional image 
sensing apparatus; 
5 Fig. 7A shows the response characteristics with 

respect to frequency of an angular velocity sensor; 

Fig. 7B is a timing chart showing the processing 
timings of the conventional image sensing apparatus; 

Fig. 8 is a block diagram showing a shake correction 
10 apparatus in the first embodiment of the present invention ; 

Fig. 9 is a timing chart for explaining the operation 
of a correction data determination means of the first 
embodiment ; 

Fig. 10 is a timing chart for explaining operations 
15 from storage of an image sensing device until correction upon 
operation of an electronic shutter in the first embodiment ; 

Fig. 11 is a block diagram showing a shake correction 
apparatus in a modification (first modi f ication) of the first 
embodiment of the present invention; 
20 Fig. 12 is a timing chart for explaining operations 

from storage of an image sensing device until correction upon 
operation of an electronic shutter in the first modification; 

Fig. 13 is a block diagram showing a vibration 
correction apparatus in the second embodiment of the present 
25 invention ; 
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Fig. 14 is a timing chart for explaining operations 
from storage of an image sensing device until correction upon 
operation of an electronic shutter in the second embodiment ; 

Fig. 15 is a block diagram showing a vibration 
5 correction apparatus in the third embodiment of the present 
invention; 

Fig. 16 is a timing chart for explaining operations 
from storage of an image sensing device until correction in 
the third embodiment; 
10 Fig. 17 is a block diagram showing the arrangement of 

an image sensing apparatus according to the fourth embodiment 
of the present invention; 

Fig. 18 is a flow chart showing the flow of pan 
determination in the image sensing apparatus according to 
15 the fourth embodiment; 

Fig. 19 is a timing chart showing the processing 
timings of the image sensing apparatus of the fourth 
embodiment ; 

Fig. 20 is a timing chart showing the processing 
20 timings of the image sensing apparatus according to a 

modification (second modification) of the fourth embodiment ; 

Fig. 21 is a block diagram showing the arrangement of 
an image sensing apparatus according to the fifth embodiment 
of the present invention; 



Fig. 22 is a timing chart for explaining the operation 
of a correction data determination means of the image sensing 
apparatus in the fifth embodiment ; 

Fig. 23 is a timing chart for explaining operations 
5 from storage of an image sensing device to correction upon 
operation of an electronic shutter in the image sensing 
apparatus of the fifth embodiment ; 

Fig. 24 is a block diagram showing the arrangement of 
an image sensing apparatus according to the sixth embodiment 
10 of the present invention; 

Figs. 25A and 25B show the response characteristics 
of an angular velocity sensor that constructs a shake 
detection means of the image sensing apparatus of the sixth 
embodiment ; 

15 Fig. 26 shows a look-up table for obtaining a sampling 

point and phase compensation amount on the basis of the shake 
frequency and shutter speed of the image sensing apparatus 
of the sixth embodiment; and 

Fig. 27 is a block diagram showing the arrangement of 

20 an image sensing apparatus according to a modification (third 
modification) of the sixth embodiment. 

DETAILED DESCRIPTION OF THE INVENTION 

25 <First Embodiment> 
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The first embodiment of an image sensing apparatus 
according to the present invention will be described in 
detail below. 

Fig. 8 is a block diagram showing a basic arrangement 

.5 of a shake correction system of the image sensing apparatus 
according to the present invention. This image sensing 
apparatus is composed of an image sensing unit and camera 
shake correction unit. The image sensing unit (camera unit) 
has a lens 150, image sensing device 161, and signal 

10 processing circuit 162. The signal processing circuit 162 
converts an electrical signal output from the image sensing 
device 161 into a standard video signal, and has a video output 
terminal 169, from which the standard video output is 
obtained . 

15 The image sensing apparatus also has an angular 

velocity sensor 101 serving as a shake detection means, a 
DC cut filter 102, an amplifier 103, a computer (to be 
abbreviated as COM hereinafter) serving as a correction 
amount calculation means, an electronic shutter 181 serving 

20 as an AE control means, a read controller 183, a timing 

generator 184, and a correction data determination unit 182 . 

The angular velocity sensor 101 comprises, e.g. , a 
vibration gyro as in the conventional image sensing apparatus 
main body, and detects any shake of the image sensing 

25 apparatus main body in two coordinate axes which are fixed 
with respect to the apparatus main body. In the description 
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of Fig. 8 as well, two angular velocity signals will be 
explained as one angular velocity signal for the sake of 
simplicity. 

The DC cut filter 102 cuts off DC components of an 
5 angular velocity signal output from the angular velocity 
sensor 101, and passes only AC components, i.e., shake 
components. The amplifier 103 appropriately amplifies the 
angular velocity signal output from the DC cut filter 102 . 
The COM has a microcomputer, and also has an A/D 

10 converter 104a, high-pass filter (HPF) 105, integral circuit 
or integrator 106, and pan/ tilt determination circuit 107. 
These circuits make substantially the same operations as 
those of the conventional apparatus (Fig. 1) . 

Upon comparison between the arrangements of Figs . 8 

15 and 1, the apparatus of the embodiment shown in Fig. 8 further 
has the correction data determination unit 182 . Note that 
the image sensing apparatus of the first embodiment has no 
D/A converter connected to the integrator 106 as compared 
to the conventional apparatus shown in Fig. 1 . However, this 

20 difference is not essential, and in the apparatus shown in 
Fig. 8, the correction data determination unit 182 
determines correction data on the basis of digital data from 
the integration circuit, and then converts it into an analog 
value . 

25 Also, the read controller 183 in the image sensing 

apparatus of the first embodiment performs substantially the 
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same operation as that of the controller 910 shown in Fig. 1. 
Hence, the image sensing apparatus of the first embodiment 
shown in Fig. 8 is characterized by the correction data 
determination unit 182. As will be described later, the 
5 correction data determination unit 182 determines the 
correction start timing in the read controller 183 in 
accordance with the storage start timing done by the 
electronic shutter 181, thus eliminating shortcomings 
resulting from the timing difference described previously 

10 in relation to Fig. 1. 

To eliminate the shortcomings, the COM of the first 
embodiment samples angular velocity data a plurality of 
number of times within one field period and, hence, 
determines panning /tilting and updates the integral value 

15 by the integration circuit 106 the same number of times . That 
is, the correction data determination unit 182 receives an 
integral value output updated a plurality of number of times 
at predetermined timings from the integrator 106 within one 
field period. 

20 The operation of the correction data determination 

unit 182 will be explained below with reference to the timing 

chart shown in Fig . 9 . 

Referring to Fig. 9, reference numeral 381 denotes a 

vertical (V) synchronization signal. Reference numerals 
25 1391 to 1394 denote conversion timings (sampling timings) 

at which the A/D converter 104a converts an angular velocity 
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signal obtained by the angular velocity sensor 101 into a 
digital amount 104f. For the sake of simplicity, Fig. 9 
shows four sampling timings per field period at equal 
intervals. However, the number of times of sampling is not 
5 limited to four, but may be a plurality of number of times. 
Also, the interval need not be an equal interval as long as 
the phase relationship with the V synchronization signal 3 81 
is appropriately set. 

Four consecutive angular velocity signals 104f sampled 

10 at the timings 1391 to 1394 are converted into angular 

displacement signals at each sampling timing in the COM and 
panning control is made as in the prior art described above . 

Such calculations in the COM are made at synchronous 
timings as the above-mentioned A/D conversion timings, i.e. , 

15 at timings 1401 to 1404 shown in Fig. 9, thus obtaining 

updated integral outputs (104g) from the integrator 106. A 
calculation output that reflects the sampling value 13 91 of 
the angular velocity is denoted by 1402, and a calculation 
output that reflects the sampling value 1392 of the angular 

20 velocity is denoted by 1403. In this way, a target 

calculation output that reflects the sampling data can be 
obtained from the COM at each sampling timing. 

The correction data determination unit 182 selects one 
of integral value outputs 104g obtained at the timings 1401 

25 to 1404, which are output from the COM. This selection 

depends on the control mode of the electronic shutter 181. 
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More specifically, the correction data determination unit 
182 determines which one of the integral outputs obtained 
at the timings 1401 to 1404 is used, depending on the fraction 
of a normal storage time period (a storage time period set 
5 when no electronic shutter operation is made) that the image 
sensing device 161 controlled by the electronic shutter 181 
assigns to charge storage. For example, in case of Fig. 9, 
the correction data determination unit 182 selects the 
integral value output obtained at the timing 1402 , determines 

10 it as correction data 1411, and uses the correction data 1411 
in read control of the image sensing device in the next field, 
thus executing shake correction described previously with 
reference to Fig. 4. 

The determination process of the correction data 1411 

15 in Fig. 9 will be described below using Fig. 10 on the basis 
of the relationship with the storage time period (i.e., 
electronic shutter speed) of the image sensing device. 

Fig. 10 shows movement of an image stored in the image 
sensing device and extraction timing, as in Fig. 6 mentioned 

20 above, and the same storage control of the image sensing 
device as in the above description is made. 

Unlike Fig. 6, Fig. 10 is characterized in that the 
integral output data used in image extraction for correction 
is obtained at nearly the central time of the charge storage 

25 period of the image sensing device 161. 
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If angular velocity signals are sampled at timings 1431 
to 1435 within one field, integral results based on these 
sampled angular velocity signals are obtained at timings 1441 
to 1445. Note that reference numeral 1765 denotes the 
5 central time of a time period 1811 required for actual charge 
storage in the first field in Fig. 10 in the image sensing 
device 161. The correction data determination unit 182 
selects the sampling point 1434 close to this timing 1765, 
in other words, it selects the integral result obtained at 
10 the timing 1444 from those obtained at the timings 1441 to 
1445. 

Since the electronic shutter operation requires charge 
accumulat ion time periods 1811 to 1814 for the CCD 161, an 
image observed during these storage time periods has 

15 displacements 1771 to 1774. The integral values of these 
image displacements 1771 to 1774 have values 1781 to 1784 
(corresponding to barycentric positions) . The timings at 
which the image displacements 1771 to 1774 change and assume 
values corresponding to the barycentric positions nearly 

20 match central times 1776 to 1768 of the charge storage time 
periods 1811 to 1814. In other words, the timing at which 
the image is displaced during operation of the electronic 
shutter is located at the barycentric position is the 
sampling timing of angular velocity information, i.e., 

2 5 matches the central time of the charge storage time period. 
As a result, a time mismatch (Fig. 6) described in the above 
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prior art can be prevented. Compared to the prior art, the 
differences between the displacement barycentric values 
{1781 to 1784) and correction reference position 1704 are 
much smaller than those between the correction reference 
5 position 1327 and displacement barycentric positions 1322 
to 1335 during the actual storage time periods of the image 
sensing device described with reference to Fig. 6. 

Hence, the sampling timing is not fixed at nearly the 
central time of the synchronization period unlike the prior 

10 art, but instead, the integral value output (the output from 
the integrator 106) based on the angular velocity sampled 
at nearly the central time of the actual storage time period 
after the electronic shutter is turned off (i.e., after 
charge storage has been actually started) is selected, thus 

15 obtaining high anti-shake performance. 

In the first embodiment, since the calculation result 
of the correction target value determined by the correction 
data determination unit 182 depends on the shutter speed 
selected by the electronic shutter 181, unique selection data 

20 corresponding to the shutter speed may be prepared. 

The correction data determination unit 182 may be 
constructed by a gate that receives the shutter speed of the 
electronic shutter as a control input. More specifically, 
the time duration from the V synchronization signal until 

25 that gate opens is determined in correspondence with the 
input shutter speed information. 
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The same applies when a change in the synchronization 
interval of the image sensing apparatus itself is used as 
a control input instead of the electronic shutter operation. 

5 <Modif ication of First Embodiment> . . .First 

Modification 

Fig. 11 is a block diagram showing the basic 
arrangement of the shake correction system of the image 
10 sensing apparatus according to a modification of the first 
embodiment . 

The same reference numerals in Fig. 11 denote the same 
parts as in the first embodiment mentioned above, and a 
detailed description thereof will be omitted. 

15 Referring to Fig. 11, this modification is different 

from the first embodiment in that the A/D converter 104a can 
receive and detect the operation timing of the electronic 
shutter 181 therefrom. More specifically, a control signal 
of the electronic shutter 181 is supplied to the A/D converter 

20 104a to control the sampling timing of the A/D converter 104a. 

As can be seen from the description of the first 
embodiment, the correction timing for shake correction 
largely depends on the timing of the electronic shutter, in 
other words, the sampling timing of the angular velocity 

25 signal can be determined if the electronic shutter timing 
is determined. However, since the electronic shutter timing 
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can be arbitrarily set by the user, if a large number of 
angular velocity sampling timings are set in correspondence 
with such arbitrary electronic shutter timings, the overall 
apparatus becomes bulky. Hence, in this modification, four 
5 sampling timings corresponding to four different (N 

different, in principle) shutter speeds are set, and if a 
shutter speed other than these four different shutter speeds 
is used, one of the four sampling timings is used after 
correction, thus simplifying the apparatus. 

10 Fig. 12 is a view for explaining the operation of the 

correction data determination unit 182 as in Fig. 9, and also 
explaining the operation timing of the A/D converter 104a. 

Referring to Fig. 12, reference numeral 1381 denotes 
a vertical synchronization signal. Reference numerals 1391 

15 to 1398 denote conversion timings (sampling timings) at which 
an angular velocity signal obtained by the angular velocity 
sensor 101 is converted into a digital amount by the A/D 
converter 104a. The angular velocity information sampled at 
each sampling timing is converted into angular velocity 

20 information in units of samples in the COM as in the first 
embodiment . Such calculations in the COM are made at 
synchronous timings as the A/D conversion timings, and 
integral calculation outputs of the integrator 106 are 
obtained at timings 1401 to 1408 in Fig. 12. 

25 The correction data determination unit 182 selects an 

optimal point as an extraction position for camera shake 
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correction from the timings 1401 to 1404 (or 1405 to 1408) 
on the basis of the shutter speed. In Fig. 12 , since the user 
has selected shutter speed S (n) (n is a value ranging from 
1 to 4 in the example in Fig. 12), the timing 1403 
5 corresponding to that speed is selected, and an integral 
result is used in image correction at a timing 1411 
corresponding to the timing 1403. 

When the user has changed the shutter speed from S(n) 
to S'(n) (?£= S(n)), the timing 1403 is not to be selected. 

10 If there isn' for which S ' (n) =S(n') holds, a sampling timing 
corresponding to such S (n* ) can be selected. This is because 
the sampling timing corresponding to S(n') matches the 
sampling timing of the A/D converter 104a at nearly the 
central time of the actual storage time period of the image 

15 sensing device. 

If there is no n' for which S' (n) = S(n') holds, this 
modification delays the sampling timing of the A/D converter 
104a by a time period corresponding to the shutter speed 
difference {S(n) - S' (n) } , as shown in Fig. 12. In Fig. 12, 

20 1395' to 1398' indicate the A/D conversion timings before 
being delayed, and 1405 ' to 1408 ' indicate the output timings 
of the integral results . The A/D converter receives 
information that pertains to the changed shutter speed (= 
S'(n)) from the electronic shutter, A/D-converts the 

25 information at timings 1395 to 1398 with a delay of a time 
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interval 1419, and outputs the integral results at timings 
1405 to 1408. 

The correction calculation result output timings 1405 
to 1408 as the following processing are those obtained based 
5 on the outputs from the A/D converter 104a at the central 
times of charge storage time periods, i.e., no time 
difference is produced. 

In this embodiment, since the delay amount determined 
by the correction data determination unit 182 depends on the 
10 shutter speed selected by the electronic shutter 181, unique 
selection data corresponding to the shutter speed may be 
prepared . 

The timing can be delayed using a presettable counter. 
More specifically, a plurality of different delay time values 
15 corresponding to different change amounts of the shutter 
speed are stored as data, and when the shutter speed has 
changed, a delay time value corresponding to that change 
amount is set in the counter. When the counter overflows, 
the output from the integrator 106 is received. 

20 

<Effect of First Embodiment> 

As described above, according to the image sensing 
apparatus of the first embodiment, since an apparatus for 
25 attaining shake correction by controlling the image read 
timing on the basis of the shake correction amount calculated 
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based on the detected shake information comprises a 
correction data determination means for selecting the shake 
correction amount at a timing which varies depending on the 
drive condition of an image sensing device such as an 
5 electronic shutter operation, and supplying the selected 
shake correction amount to a read control means, a 
sufficiently high anti-shake effect can be obtained even when 
storage & read control of the image sensing device is done 
based on the electronic shutter operation. 
10 Since shake information is sampled at a timing 

corresponding to nearly the central time of the storage time 
period of the image sensing device, there is no timing 
difference between shake detection and shake correction, 
thus obtaining a maximum anti-shake effect. 

15 

< Second Embodiment> 

In the first embodiment and its modification, a 
plurality of different (N) sampling timings are set in 

20 advance in correspondence with different shutter speeds, and 
the angular velocity is sampled at these sampling timings 
during each field period to obtain N angular velocity signals . 
The N angular velocity signals undergo HP processing, and 
the obtained N time-sequential angular velocity signals 

25 undergo N continuous integral calculations to obtain N 
integral values . 
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In the second embodiment, one sampling timing (e.g., 
timing 1434 in Fig. 10) is selected in correspondence with 
the shutter speed, and the A/D converter 104a A/D-converts 
angular velocity data at that selected A/D conversion timing. 
5 Then, the A/D-converted data is processed via a high-pass 
filter and integrated as in the COM shown in, e.g.. Fig. 8. 
The second embodiment is different from the first embodiment 
in that only one angular velocity data is processed within 
one field period. The obtained integral result is received 

10 by the correction data determination unit 182 at a timing 
(e.g., timing 1444 in Fig. 10) a prescribed period of time 
after the A/D conversion timing. 

Fig. 13 is a block diagram showing the basic 
arrangement of a shake correction system of an image sensing 

15 apparatus according to the second embodiment. 

The same reference numerals in Fig. 13 denote the same 
parts as those in the first embodiment, and a detailed 
description thereof will be omitted. Referring to Fig. 13, 
unlike the arrangement of the first embodiment (Fig. 8) , the 

20 second embodiment does not have any correction data 

determination unit 182 of the first embodiment. For this 
reason, in the image sensing apparatus of the second 
embodiment, one sampling timing of the A/D converter is set 
within one field period unlike the first embodiment. 
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The difference between the arrangements of the second 
embodiment and prior art (Fig. 1) lies in that a sampling 
timing controller 121 is added to the second embodiment. 

The operation of the sampling timing controller 121 
5 will be explained below with reference to the timing chart 
in Fig. 14. 

Fig. 14 shows movement of an image stored in the image 
sensing device and extraction timings along with an elapse 
of time as in Fig. 6 explained previously, and the same 

10 storage control of the image sensing device as in the above 
description is made . 

The sampling timing controller 121 sets the sampling 
timing of shake data (angular velocity data) at nearly the 
central time in the storage time period of the image sensing 

15 device on the basis of information that pertains to the 
shutter speed and received from the electronic > shutter 181. 

Reference numeral 1531 to 1534 denote sampling timings 
within the respective fields, which are set by the sampling 
timing controller 121 . Compared to the sampling timings 1315 

20 to 1318 described in Fig. 6, the timings 1531 to 1534 in 
Fig. 14 are shifted to the timings 1336 to 1339 indicating 
the storage central times of the image sensing device. 

The integrator 106 of the second embodiment calculates 
correction target values (integral values) on the basis of 

25 shake information sampled at the timings 1531 to 1534, and 
outputs the calculation results at timings 1541 to 1544. 



Compared to the displacement barycentric positions 
1332 to 1335 in the actual storage time periods of the image 
sensing device described previously with reference to Fig . 6 , 
displacement barycentric positions 1781- to 1784 according 
5 to the second embodiment shown in Fig. 14 are closer to a 
correction reference position 1327. 

The time delay amount set by the sampling timing 
controller 121 is uniquely determined based on the operation 
mode of the electronic shutter 181, i.e. , the actual storage 

10 time. Hence, the sampling timing controller 121 can 
determine the sampling timing when sampling phases 
corresponding to operation modes of the electronic shutter 
are prepared as data, or are calculated on the basis of the 
actual storage time period. 

15 Since the sampling timing controller 121 adjusts the 

sampling point of data to be selected to nearly the central 
time of the actual storage time period of the image sensing 
device without fixing the sampling timing at nearly the 
central time between adjacent synchronization signals in the 

20 prior art, high anti -shake characteristics can be assured. 

The same applies when a change in the synchronization 
interval of the image sensing apparatus itself is used as 
a control input instead of the electronic shutter operation. 

The second embodiment calculates the correction target 

25 value immediately after the sampling timing of a shake signal . 
However, since the calculation for obtaining the correction 
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target value need only be finished before the next extraction 
control, it need not be made immediately after sampling. 

< Third Embodiment> 

5 

The third embodiment of an image sensing apparatus 
according to the present invention will be described in 
detail below with reference to Fig. 15. 

The image sensing apparatus of the third embodiment 

10 has been proposed to remove correction delays resulting from 
any response delay of the gyro 101 serving as a sensor. For 
this purpose, the third embodiment is characterized by 
further comprising a detector 122 for detecting a frequency 
component in an angular velocity signal, in addition to the 

15 second embodiment. 

The frequency detector 122 makes a computation such 
as FFT, and detects the average value of a plurality of 
frequencies, which are detected as those having power levels 
equal to or higher than a predetermined power level . The 

20 frequency component in the angular velocity signal detected 
by the detector 122 is supplied to the timing controller 121. 

The frequency detector 122 also detects a frequency 
component in integrated angular velocity data, i.e., a 
displacement amount 104g. Such detection is made in 

25 consideration of a certain tendency of the angular velocity 
sensor 101 : the sensor 101 outputs a signal with a high output 
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level in response to an angular velocity change with a high 
frequency, and outputs a signal with a low-output level in 
response to an angular velocity change with a low frequency. 
That is, in order to accurately detect a low frequency 
component, it is effective to use the signal 104g as an 
integral, the signal level of which has been apparently 
amplified. 

Note that the detector 122 may use a method using the 
count value of sign changes in signals per unit time period 
as a simple frequency detection method. 

Shake frequency information detected by the frequency 
detector 122 is used by the sampling timing controller 121 
to control to generate a sampling timing, which is advanced 
by a predetermined phase corresponding to the detected 
frequency . 

More specifically, since the sampling phase need be 

advanced by the response delay angle (Fig. 7A) of the angular 

velocity sensor 101 as the shake detection means, if a shake 

of 10 Hz acts on the image sensing apparatus and the phase 

delay of the angular velocity sensor is 9 deg on the basis 

of the characteristics shown in Fig. 7A, the angular velocity 

sensor output has a delay time of 0.25 ms as per: 

^it^ |X^0[Hz]=0.25[ms] 
360 [degj 

Hence, the sampling timing controller 121 suffices to advance 
the sampling timing by 0.25 ms . 
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The operation of the sampling timing controller 121 
according to the third embodiment will be described below 
with the aid of Fig. 16. 

Referring to Fig. 16, unlike the second embodiment 
5 described above using Fig. 14 and the like, a plurality of 
sampling points must be set within one field to improve the 
frequency detection precision. In the third embodiment, 
four sampling points are set per field for the sake of 
convenience, but the number of sampling points is not 

10 particularly limited. 

In Fig. 16, reference numeral 1561 to 1568 denote the 
sampling points of a shake signal. Normal sampling is done 
between a vertical synchronization timing 1381 and the next 
synchronization timing 1382. 

15 When the frequency detector 122 detects a higher shake 

frequency in the output from the A/D converter 104a, the 
timing controller 121 controls to advance the sampling point 
of the shake signal in correspondence with the detected shake 
frequency, as described above . At the next synchronization 

20 timing 1382 and subsequent timings, the sampling timings are 
changed to timings 1565 to 1568 which lead standard timings 
1565' to 1568' by a predetermined period of time. 

Similarly, the correction calculation result output 
timings are changed from output timings 1405 ' to 1408 ' for 

25 previous fields to timings 1405 to 1408. However, the phases 
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of control points 1411 and 1412 for image extraction remain 
unchanged with respect to the calculation timings. 

<Effect of Third Embodiment > 

5 

As described above, according to the image sensing 
apparatus of the third embodiment, since appropriate shake 
information can be sampled by varying the sampling timing 
of a sampling means in correspondence with the drive & storage 
10 conditions of the image sensing device such as electronic 
shutter operation, frequency information obtained by a shake 
detection means, and the like, smooth anti-shake operation 
can be done independently of the drive & storage conditions 
of the image sensing device, shake frequency, and the like. 

15 

<Fourth Embodiment> 

The fourth embodiment has been proposed to solve the 
third problem with the prior art. More specifically, an 
20 image sensing apparatus of the fourth embodiment can 

effectively use a COM in processing other than that for 
obtaining a correction amount. 

Fig. 17 shows the arrangement of the image sensing 
apparatus of the fourth embodiment. The same reference 
25 numerals in Fig. 17 denote the same parts as those in the 
aforementioned embodiments. 
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The apparatus arrangement of the fourth embodiment 
shown in Fig. 17 is different from that of the first 
embodiment shown in Fig. 8 in that a memory 110 and AF 
(auto-focus) control circuit 111 are added in the COM. 
5 The memory 110 is an internal RAM or the like of a 

microcomputer (not shown) included in the COM, is inserted 
between the A/D converter 104a and HPF 105 , and stores angular 
velocity data sampled at timings 2401 to 2404 (Fig. 19) . The 
AF control circuit 111 is connected to the signal processor 

10 190 and lens 150, and controls the lens 150 to attain auto 
focusing while the COM is not calculating. 

Pan determination in the pan/ tilt determination 
circuit 112 in the image sensing apparatus of the fourth 
embodiment will be explained below with reference to the flow 

15 chart shown in Fig. 18. 

Note that the COM repetitively executes this flow at 
timings corresponding to interrupt periods . When no 
interrupt request is generated, i.e. , when a calculation for 
anti-shake control need not be made, the COM provides a 

20 service for auto-focus control using the AF control circuit 
111. 

Upon generation of an interrupt request, in step S12 01 
an angular velocity signal amplified by the amplifier 103 
is sampled by the A/D converter 104a and is converted from 
25 an analog amount into a digital amount that can be processed 
inside the COM. This digital data is stored in the memory 
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110 in the COM. It is checked in step S1202 if sampling has 
been completed a predetermined number of times . If NO in step 
S1202, this interrupt processing ends without any 
processing; otherwise, the flow advances to step S1203 . 
5 Since a loop of step S1201 -> step S1202 -> step S1201 

repeats itself in correspondence with the four sampling 
timings 2401 to 2404, if it will have been determined as YES 
in step S1202, four speed data will have been stored in the 
memory 110. 

10 Step S12 03 is executed when an interrupt corresponding 

to one of timings (correction amount calculation timings) 
2501 to 2504 is generated. 

In step S1203, shake signal data stored in the memory 
110 in step S12 01 are read out. In step S12 04, the HPF 105 

15 then makes a calculation for data corresponding to the number 
of samples read out in step S1203 using a cutoff frequency 
f c prepared in the previous process. In step S1205, the 
integrator 106 integrates these data using a time constant 
x prepared in the previous process. In step S1206, the 

20 integral (i.e., an angular displacement signal) instepS1205 
is converted into an analog amount by a D/A converter 104b, 
and the converted analog signal is output to the read 
controller 183. 

It is then checked in step S12 07 if the angular velocity 

25 signal is equal to or higher than a predetermined threshold 
value TH-l. If YES in step S1207, the cutoff frequency f c of 
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the HPF 105 is set to be higher by a predetermined value than 
the current value to set the attenuation factor in the 
low-frequency range to be higher than the current one, in 
step S1208. In step S1209, the time constant X used in the 
5 integral calculation of the integrator 106 is set to be 
shorter by a predetermined value than the current value so 
that the angular displacement output comes close to the 
reference value, thus ending this processing. 

On the other hand, if it is determined in step S12 07 

10 that the angular velocity signal is lower than the 

predetermined threshold value TH. 1 , it is checked in step S1210 
if the integral value is equal to or larger than a 
predetermined threshold value TH 2 . If YES in step S1210, a 
panning/ tilting state is determined and the flow advances 

15 to step S1208; otherwise, a normal control state or a 

panning/ tilting completion state is determined, and the 
cutoff frequency f c used in the calculation of the HPF 105 
is set to be lower by a predetermined value than the current 
value in step S1211 to set the attenuation factor in the 

2 0 low- frequency range to be lower than the current one . In step 
S1212, the time constant value used in the integral 
calculation of the integrator 106 is set to be longer by a 
predetermined value than the current value to improve the 
integral effect, then ending this processing. 

25 As described above, the control sequence shown in 

Fig. 18 starts in response to various timer interrupts. 
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Hence, while no timer interrupt is generated, the COM 
provides a service for auto- focus control. 

With the above-mentioned control, the COM makes the 
same calculations as those in the prior art, and can also 
5 be used in processing such as auto-focus control. 

Fig. 19 is a timing chart showing the processing 
timings of the image sensing apparatus according to the 
fourth embodiment. Fig. 19 is a timing chart for explaining 
the correction amount calculation timings and correction 

10 timings in relation to the sampling timings of shake 

information. Referring to Fig . 19, reference numerals 23 01 
to 2303 denote vertical synchronization signals; and 2401 
to 2408, sampling timings, i.e., conversion timings at which 
an angular velocity signal obtained by the gyro 101 serving 

15 as the angular velocity sensor is converted into a digital 
amount by the A/D converter 104a. These sampling intervals 
have an appropriate phase relationship with the vertical 
synchronization signals 2301 to 2303 and are equal to each 
other, as shown in Fig. 19. In the fourth embodiment, as in 

20 the above embodiments, the number of times of sampling per 
field between the vertical synchronization periods is four. 
However, the number of times of sampling is not limited to 
four, but may be a plurality of number of times. 

Angular velocity information sampled by the A/D 

25 converter 104a is stored in the memory 110 in the COM as a 
digital amount once every sampling. When a predetermined 



number of times of sampling are complete or when a 
predetermined timing has been reached, conversion from 
angular velocity information into angular displacement 
information is made for all the sampled data. As shown in 
5 Fig. 19, after sampling at the final sampling timing 2404 
in one field is executed, angular velocity data sampled at 
the sampling timings 2401 to 2404 and stored in the memory 
110 undergo calculations during the period between the 
correction amount calculation timings 2501 and 2504. 

10 Likewise, as for the sampling timings 2405 to 2408 in 

the next field, after sampling is done at the sampling timing 
2408 as the final sampling point, angular velocity data 
sampled at the sampling timings 2405 to 2408 and stored in 
the memory 110 undergo calculations during the period between 

15 the correction amount calculation timings 2505 and 2508. 

Furthermore, the read controller 183 executes read 
control of the image sensing device using the calculation 
outputs obtained at the correction amount calculation 
timings 2504 and 2508 at the end of video periods output from 

20 the COM as shake correction target values 2601 and 2602, as 
in the processing described in the prior art. 

Hence, when timings shown in Fig. 19 are set, the 
period from the time upon determination of the correction 
timing one field before until the next correction amount 

25 calculation timing need only be used for sampling shake 



information, and the internal processing of the COM can be 
simplified. 

Furthermore, the calculation timings will be explained 
using Fig. 19. In this case, calculations corresponding to 
5 the correction amount calculation timings 2501 to 2508 are 
done at processing timings 2701 to 2708 in the COM. On the 
other hand, calculations for determining the extraction 
position of the image sensing device are done at processing 
timings 2709 and 2710 in the COM. As can be seen from Fig. 19, 

10 except for the time period required for A/D conversion, since 
the COM uses a continuous time period in one field, 
non-calculation time periods 2711 and 2712 of the COM can 
be used for other calculations . 

The COM can be used in other purposes, such as 

15 auto -focus control, auto exposure control, and the like of 
the image sensing apparatus. In the above description, the 
shake correction means executes so-called extraction 
correction implemented by extracting a portion of a sensed 
image, but other shake correction means, e.g., an optical 

20 correction means, may be used. 

<Modif ication of Fourth Embodiment> ... Second 
Modi ficat ion 

25 A modification of the fourth embodiment (i.e., the 

second modification) will be described below with the aid 
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of the timing chart shown in Fig. 20. This second 
modification is characterized in that integral calculations 
are started at a timing between the final and second final 
sampling timings, while the fourth embodiment is 
5 characterized in that the integral calculations of angular 
velocity signals start after the final sampling timing of 
the angular velocity signal. 

Note that the basic arrangement of the image sensing 
apparatus according to the second modification is the same 

10 as that shown in Fig. 17 in the aforementioned fourth 
embodiment, and will be explained using Fig. 17. 

Fig. 20 is a timing chart showing the processing 
timings of the image sensing apparatus according to the 
second modification. Fig. 2 0 is a timing chart for 

15 explaining the correction amount calculation timings and 
correction timings in relation to the sampling timings of 
shake information. 

Fig. 20 is different from Fig. 19 in the calculation 
timings of the COM. 

20 More specifically, the phases of correction amount 

calculation timings 2501' to 2504' and processing timings 
2701' to 2704' and 2709" in the COM as the calculation start 
timings corresponding to the angular velocity sampling 
timings 2401 to 2404 are earlier than those in the timing 

25 chart shown in Fig. 19 in the fourth embodiment. These 
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processing timings are set when another calculation is to 
be additionally executed in the COM (2713). 

Such control is done when the drive condition of a focus 
motor or the read control of the image sensing device is 
5 temporarily changed. The processes in the COM are finished 
at earlier processing timings 2701' to 2704' and 2709', and 
another processing may be inserted in this idle time period. 

The calculation timings of the second modification can 
be set after the sampling timing 2404 as the final sampling 

10 point in one field, and before the correction calculation 
timing 2504', thus posing no problem. 

Since the processing time period required for 
calculations is known in advance, whether or not another 
processing can be executed after the sampling timing 2404 

15 and before the correction amount calculation timing 2501' 
can be easily determined. 

Furthermore, in the second modification, shake signals 
sampled at the sampling timings within one field undergo 
calculations to obtain correction data. However, these 

2 0 sampling timings need not fall within a single field. For 
example, correction data corresponding to the- correction 
timing 2601 may be calculated using data sampled at the 
sampling timings 2403 to 2406, and the next correction data 
can be calculated using four sampling data after the sampling 

25 timing 2407. 



- 63 - 



<Effect of Fourth Embodiment and the like> 



As mentioned above in detail, according to the image 
sensing method and apparatus of the fourth embodiment and 
5 second modification, since the computation means such as a 
microcomputer or the like can be used in continuous 
processing other than shake correction control, it can be 
efficiently used in other purposes while executing shake 
correction control . 
10 According to the second modification, the degree of 

freedom in the design of integration start points can be 
improved . 

<Fifth Embodiment> 

15 

The fifth embodiment of the present invention will be 
explained with reference to Fig. 21 and the subsequent 
figures . The fifth embodiment is an improvement of the image 
sensing apparatus of the first embodiment, and accurately 

20 synchronizes the sampling timing of an angular velocity 
signal with the center time of an actual storage time period. 

Fig. 21 is a block diagram showing the arrangement of 
the image sensing apparatus according to the fifth embodiment . 
The same reference numerals in Fig. 21 denote the same parts 

25 as those in the apparatuses in the above embodiments, and 
a detailed description thereof will be omitted. 
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The apparatus shown in Fig. 21 is different from that 
shown in Fig. 8 (first embodiment) in that a phase 
compensation circuit 113 is added. 

The phase compensation circuit 113 is inserted between 
5 the integral circuit 106 and D/A converter 104b. The phase 
compensation circuit 113 is also connected to the electronic 
shutter 181 serving as an AE control means . 

In the first embodiment, the A/D converter 104a samples 
an angular velocity signal once per field, and the correction 

10 amount is calculated once per field, accordingly. However, 
in the fifth embodiment, an angular velocity signal is 
sampled and a shake correction target value is calculated 
each a plurality of number of times during one field period, 
as in the third and fourth embodiments and the like. 

15 The operation of the correction data determination 

unit 182 will be explained below with reference to the timing 
chart shown in Fig. 22. 

Referring to Fig. 22, reference numeral 3314 denotes 
a vertical synchronization signal. Reference numerals 3201 

20 to 32 04 denote conversion timings (= sampling timings) at 
which an angular velocity signal obtained by the gyro sensor 
(angular velocity sensor) 101 is converted into a digital 
amount by the A/D converter 104a. In the fifth embodiment, 
sampling is made four times at equal timing intervals during 

25 one field period for the sake of simplicity. However, the 
number of times of sampling need only be a plurality of times, 
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and the intervals need not be equal to each other as long 
as the sampling timings have an appropriate phase 
relationship with the synchronization signal 3314. 

Angular velocity information sampled by the A/D 
5 converter 104a undergoes conversion from angular velocity 
information into angular displacement information in the COM 
and also undergoes panning control upon each sampling. 
Calculations in the COM are also made at timings synchronized 
with the aforementioned A/D conversion timings, and 

10 correction calculation outputs as correction target values 
used in shake correction are obtained at timings 3315 to 3318 
shown in Fig. 22. 

In Fig. 22, the output 3315 from the integrator 106 
reflects angular velocity data sampled at the timing 32 01, 

15 and the calculation output 3316 reflects angular velocity 
data sampled at the timing 3202. In this fashion, in the 
fifth embodiment, every time one angular velocity data is 
sampled (3201 to 3204), a shake correction target calculation 
output which reflects that sampled data is obtained at a 

20 corresponding one of the timings 3315 to 3318. 

The phase compensation circuit 113 varies the signal 
phase of the output from the integrator 106 by a predetermined 
amount . The compensated signals are obtained at timings 3205 
to 3208. 

25 The phase compensation by the phase compensation 

circuit 113 may be implemented by a combination of phase 
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advance and delay filters and the like or by software in the 
COM so as to control the phase advance or delay amount. In 
practice, the circuit 113 has a filter arrangement as a 
combination of a low-pass filter, high-pass filter, and the 
5 like. The phase compensation circuit 113 may use a delay 
means such as a shift register or the like. 

The phase advance or delay amount set by the phase 
compensation circuit 113 is varied on the basis of the control 
mode of the electronic shutter 181 serving as an AE control 
1 0 means . 

In this way, four angular velocity signals sampled by 
the A/D converter 104a are output from the COM as four 
phase-compensated correction target values. 

The correction data determination unit 182 will be 

15 explained below. 

The correction data determination unit 182 selects an 
optimal point as an extraction target value from the 
phase-compensated calculation outputs 3205 to 3208 output 
from the COM. This selection condition depends on the 

20 control mode of the electronic shutter 181. More 

specifically, the calculation output timing to be selected 
is determined in correspondence with the ratio between the 
actual storage time period the control mode sets in the image 
sensing device 161, and a normal storage time period in that 

25 image sensing device. For example, in Fig. 22, the 

calculation result 3206 is selected as correction data 3319. 
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The selected correction data is used by the read controller 
183 in image area extraction control for the subsequent 
field. 

The relationship among the shake correction target 
5 value calculation output timings, phase compensation amounts, 
and the storage time period of the image sensing device 161, 
i.e., the electronic shutter speed will be explained below 
using Fig. 23. The timing chart in Fig. 23 is different from 
that in Fig. 10 (first embodiment) in that the sampling 
10 timing of angular velocity data used in extraction by the 
A/D converter 104a is set at a timing in the neighborhood 
of the central time of a storage time period of the image 
sensing device 161, and any error between the set sampling 
timing and the central time of the actual storage time period 
15 is corrected by the phase compensation circuit 113. 

This feature will be explained below with reference 
to Fig. 23. 

Reference numerals 4301 to 4305 denote sampling 
timings within one field. Furthermore, calculation results 
20 obtained by calculating correction target values based on 
sampled shake information (angular velocity information) and 
phase-compensating these values by the aforementioned 
calculations are output at timings 4306 to 4310. 

If the central time of an actual storage time period 
25 4344 is indicated by 4336 , the fifth embodiment selects shake 
data sampled at the sampling point 43 04 close to this timing 
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433 6. The phase compensation circuit 113 makes a phase 
compensation calculation to correct a sampling delay amount 
4319 as a time delay between the central time 4336 of the 
actual storage time period 4344 and the sampling timing 43 04 
5 to obtain phase-compensated correction calculation outputs 
4306 to 4310. Of these outputs, angular velocity data 
sampled at the sampling timing 4304 undergoes integration 
by the integrator 106, and this integral output undergoes 
a phase compensation calculation, thus selecting a 

10 phase-compensated correction calculation output 43 09 as 
correction data. 

Hence, any time difference between the sampling point 
43 04 of a shake signal and the central time 433 6 of the actual 
storage time period 4344 is compensated for by the phase 

15 compensation circuit 113, so that the central time of the 
actual storage time period 4344 of the image sensing device 
161 can be set at a correction reference position 4327. 

Compared to the displacement barycentric positions 
1781 to 1784 of the first embodiment described previously 

20 with reference to Fig. 10, displacement barycentric 

positions 4315 to 4318 of the fifth embodiment are closer 
to the correction reference position 4327 (or 1327). 

Therefore, since the correction data determination 
unit 182 selects data at nearly the central time of the actual 

25 storage time period of the image sensing device 161, and the 
phase compensation circuit 131 corrects any time error 
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between the sampling timing and the central time of the actual 
storage time period of the image sensing device 161, high 
ant i -shake performance can be obtained. 

In this embodiment, since the calculation result of 
5 the correction target value selected and determined by the 
correction data determination unit 182, and the phase 
advance/delay compensation amounts by the phase compensation 
circuit 113 depend on the shutter speed selected by the 
electronic shutter 181, unique selection data corresponding 
10 to the shutter speed can be prepared. 

The same applies when a change in the synchronization 
interval of the image sensing apparatus itself is used as 
a control input instead of the electronic shutter operation. 

15 <Sixth Embodiment> 

The sixth embodiment is directed to an image sensing 
apparatus having the features of both the third and fifth 
embodiments. More specifically, the sixth embodiment can 
2 0 simultaneously compensate for a response delay of the angular 
velocity sensor 101 (function of third embodiment), and 
accurately synchronize the sampling timing of the angular 
velocity data with the central time of the storage time period 
(function of the fifth embodiment) . 
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Fig. 24 is a block diagram showing the basic 
arrangement of an image sensing apparatus according to the 
sixth embodiment. 

The same reference numerals in Fig. 24 denote the same 
5 parts as those in the aforementioned embodiments, and a 
detailed description thereof will be omitted. 

The sixth embodiment has a second phase compensation 
circuit 113b that has a function equivalent to the phase 
compensation circuit 113 in the fifth embodiment, and also 
10 has a first phase compensation circuit 113a for performing 
phase compensation of the sensor 101 in correspondence with 
the frequency and a frequency detector 122, in addition to 
the arrangement of the fifth embodiment. 

The first phase compensation circuit 113a and 
15 frequency detector 122 of the sixth embodiment have the same 
arrangements as the sampling timing controller 121 and 
frequency detector 122 of the third embodiment. 

The first phase compensation circuit 113a is inserted 
between the A/D converter 104a and HPF 105, and the second 
2 0 phase compensation circuit 113b is inserted between the 

integral circuit 106 and D/A converter 104b. The frequency 
detector 122 is connected to the A/D converter 104a, and 
detects a frequency component in angular velocity data 
sampled by the A/D converter 104a, and that in displacement 
25 data integrated by the integral circuit 106. The detection 
results of the frequency detector 122 are supplied to the 



first and second phase compensation circuits 113a and 113b. 
The pan/tilt determination circuit 107 is respectively 
connected to a connection line between the first phase 
compensation circuit 113a and HPF 105, and that between the 
5 second phase compensation circuit 113b and integral circuit 
106. 

The first phase compensation circuit 113a for 
performing phase compensation of the angular velocity sensor, 
and the frequency detector 122 are provided to eliminate 

10 influences arising from correction errors in shake 

correction due to response characteristics errors of the 
angular velocity sensor 101 with respect to the shake 
frequency. More specif ically, the response characteristics 
of the angular velocity sensor 101 such as a gyro sensor worsen 

15 as the frequency becomes higher (as has already been 
described previously with reference to Fig. 7) . 

The operations of the first phase compensation circuit 
113a and frequency detector 122 will be explained below. 

As in the third embodiment, the frequency detector 122 

2 0 makes a computation such as FFT, and uses a peak frequency 
or information obtained by averaging a plurality of frequency 
components having power levels equal to or higher than a 
predetermined level as a shake frequency. Also, as a simple 
detection method, the count value of sign changed in signals 

25 per unit time period may be used as frequency information. 



The reason why the frequency detector 122 receives two 
data, i.e. , shake information sampled by the A/D converter 
104a and a target vale signal integrated by the integral 
circuit 106, is the same as that in the third embodiment 
5 described above. That is, the angular velocity sensor 101 
has given detection characteristics: the output level is 
large for a high frequency but is small for a low frequency 
while the amplitude remains the same. Thus, the signal level 
is apparently amplified by integration so as to precisely 

10 detect a low frequency. 

Shake frequency information detected by the frequency 
detector 122 undergoes phase advance compensation for a 
predetermined phase delay corresponding to the frequency 
detected by the first phase compensation circuit 113a. More 

15 specifically, the phase is advanced by an amount that 

compensates the response characteristics shown in Fig. 7 in 
correspondence with the frequency detected by the frequency 
detector 122. For example, since there is a response delay 
of 10 deg at 10 Hz, when the frequency detector 122 detects 

20 10 Hz, the first phase compensation circuit 113a makes 
control for advancing phase by 10 deg. 

As for the arrangement of the first phase compensation 
circuit 113a, the circuit must vary its characteristics by 
determining the frequency to be corrected on the basis of 

2 5 the detected frequency using an arrangement such as a 

high-pass filter, and need only comprise an HPF or the like 
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of a second phase compensation circuit 113b (to be described 
later) . 

The operation of the second phase compensation circuit 
113b will be explained below. 
5 The second phase compensation circuit 113b of the sixth 

embodiment implements control of the phase advance/delay 
amount as in the phase compensation circuit 113 in the fifth 
embodiment. To achieve such operation, a combination of a 
low-pass filter (LPF) and high-pass filter (HPF) , the time 

10 constant of which is variable, may be used. Such filter 
depends on the passband of phase advance or delay 
characteristics. Hence, in this embodiment, in order to 
eliminate such frequency response, the phase advance/delay 
control of the second frequency compensation circuit 113b 

15 is done on the basis of two parameters, i.e., the control 
mode of the electronic shutter 181 and the frequency detected 
by the frequency detector 122. 

Figs. 25A and 25B show examples of the filter 
characteristics. The phase advance/delay control with 

20 respect to the frequency will be explained below with 
reference to Figs. 25A and 25B. 

The characteristics shown in Fig. 25Aare typical ones 
of a lst-order LPF (low-pass filter) . Referring to Fig. 25A, 
reference numeral 601 denotes gain characteristics with 

25 respect to the frequency; and 602, a change in phase under 
the same condition. When the time constant of the LPF with 
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such characteristics is changed, the gain and phase 
characteristics change and shift to the right and left on 
the graph shown in Fig . 25A. Since the phase characteristics 
are in question, changes in phase characteristics will be 
5 explained below. Upon changing the time constant , the phase 
characteristics change from a curve 603 to curve 604. 
Furthermore, when the characteristics are used as phase delay 
compensation characteristics, a portion with a small change 
in gain of the characteristics is used, and the phase delay 

10 amount can be varied without largely changing the gain. 

Hence, when an LPF is used in the second phase 
compensation circuit 113b, the time constant is uniquely 
determined by the frequency band, the phase of which is to 
be delayed, and its delay amount. 

15 Phase advance compensation will be described below 

using typical characteristics of a Ist-order HPF shown in 
Fig. 25B. Referring to Fig. 25B, reference numeral 605 
denotes gain characteristics with respect to the frequency; 
and 606, changes in phase under the same condition. 

20 When the time constant of the HPF with such 

characteristics is changed, the gain and phase 
characteristics change and shift . Since the phase 
characteristics are in question as in the LPF described above, 
a change in phase characteristics will be explained below. 

25 Upon changing the time constant, the phase characteristics 
change from a curve 607 to curve 608. Furthermore, when the 
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characteristics are used as phase advance compensation 
characteristics, a portion with a small change in gain of 
the characteristics is used, and the phase can be advanced 
without largely changing the gain. Hence, when the HPF is 
5 used in the second phase compensation circuit 113b, the time 
constant is uniquely determined by the frequency band, the 
phase of which is to be advanced, and its advance amount. 

Note that a control system which simultaneously 
performs phase advance and delay compensation comprises both 

10 the LPF and HPF, and their time constants are set in 

correspondence with the pertinent condition, thus allowing 
phase advance and delay compensation processes. 

However, as can be seen from the above characteristics , 
upon executing phase advance/delay compensation, the 

15 frequency is an important parameter. Upon executing phase 
advance/delay compensation, if the frequency varies, the 
advance or delay time also varies, and appropriate correction 
cannot be made. Hence, it is important to correct such phase 
advance/delay compensation on the basis of the detected 

20 frequency. 

In the sixth embodiment, the phase compensation 
frequency is determined based on information of the frequency 
detector 122 in addition to the advance /delay compensation 
in the fifth embodiment so as to optimally adjust that 

25 frequency. 
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Upon executing this operation, a table that stores a 
correspondence between, e.g., the control mode of the 
electronic shutter 181 and frequency information of the 
frequency detector 122 that detects the current shake 
5 frequency is prepared in advance, and the phase compensation 
frequency is uniquely determined on the basis of the 
correction data timing determined by the correction data 
determination unit 182 based on the current AE control mode, 
and the shake frequency. 

10 Fig. 26 shows an example of this table. The table 

shown in Fig. 26 describes sampling point data and phase 
compensation data using the shake frequency and AE control 
mode as arguments . The upper row of the table shows typical 
points of typical shake frequencies [Hz] , and the left column 

15 shows typical values of shutter speeds [s] as the AE operation 
modes . Note that sampling is done 10 times at equal intervals 
during one field, and phase compensation can be done in 0 . 1 
increments by dividing one sampling interval into 10 
intervals . 

20 In Fig. 26, for example, "9/-2.2" means that the ninth 

sampling point is selected, and phase compensation shifts 
by 2 .2/10 deg toward the advance side. Also, as a table data 
value with - sign becomes larger, the cutoff frequency of 
the HPF lowers; as a table data value with + sign becomes 

25 larger, the cutoff frequency of the LPF lowers . Furthermore, 
sampling is done 10 times at equal intervals during one field. 
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A value indicating a phase advance /delay indicates a shift 
amount in intervals obtained by equally dividing one sampling 
interval into 10 intervals. 

For example, when 1/1000 [s] is selected as the AE 
5 operation mode (shutter speed) , and the peak frequency = 1 
[Hz] of the current shake frequency is detected, the ninth 
sampling points of 10 sampling points in one frame is selected 
by the correction data determination unit 182 as data that 
determines the correction target value, and phase 

10 compensation for advancing phase by a ratio of 2 .2/10 in the 
time axis direction can be done by the second phase 
compensation circuit 113b. 

Therefore, since the correction data determination 
unit 182 selects nearly the central time of the actual storage 

15 time period of the image sensing device 161 as a sampling 
timing of data to be selected without fixing the sampling 
timing at nearly the central time of a synchronization period 
unlike in the prior art, and any time error between that 
sampling timing and the central time of the actual storage 

20 time period of the image sensing device 161 is corrected by 
the second phase compensation circuit 113b in consideration 
of shake frequency information, high anti-shake performance 
can be assured. 

25 <Modif ication of Sixth Embodiment> . . .Third 

Modification 
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A modification of the sixth embodiment (third 
modification) will be explained below with reference to 
Fig. 27. 

5 The third modification is characterized in that the 

first and second phase compensation circuits 113a and 113b 
of the sixth embodiment are combined into a single phase 
compensation circuit 113c. 

The phase compensation circuit 113c is inserted 

10 between the A/D converter 104a and HPF 105. The phase 
compensation circuit 113c is connected to the frequency 
detector 112 and electronic shutter 181. 

As can be understood from the description of the sixth 
embodiment, the first phase compensation circuit 113a shown 

15 in Fig. 24 serves as a phase advance compensation means using 
the HPF, and controls its advance amount on the basis of shake 
frequency information of the frequency detector 122. Also, 
the second phase compensation circuit 113b shown in Fig. 24 
serves as a phase delay/advance compensation means as a 

20 combination of an HPF and LPF , and controls the phase 

compensation amount uniquely determined based on the shake 
frequency information obtained by the frequency detector 122 
and the operation mode of the electronic shutter 181. 

In the third modification, since these circuits 

25 compensate phases commonly based on the shake information 
output from the frequency detector 122, they are combined 
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to simplify the arrangement . As for phase correction amounts , 
compensation values that consider the response 
characteristics of the angular velocity sensor 101 are 
superposed on the "sample point - phase compensation amount 
5 table" described in the sixth embodiment using Fig. 26, thus 
achieving a common phase compensation means . 

The position of the phase compensation circuit 113c 
is not particularly limited as long as it is inserted between 
the angular velocity sensor 101 and read controller 183 as 
10 in the third modification. 

<Effect of Fifth and Sixth Embodiments> 

As described in detail above, according to the image 
15 sensing method and apparatus of the fifth and sixth 

embodiments (also the third modification) , since the phase 
of a shake signal or shake correction signal is corrected 
on the basis of the drive condition of the image sensing device 
(= timing selected by the correction data determination 
20 means) , even when storage & read control of the image sensing 
device is done by electronic shutter operation, a 
sufficiently high anti-shake effect can be assured 
independently of the shake frequency. 

As many apparently widely different embodiments of the 
2 5 present invention can be made without departing from the 
spirit and scope thereof, it is to be understood that the 



invention is not limited to the specific embodiments thereof 
except as defined in the appended claims. 
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WHAT IS CLAIMED IS: 



1. An image sensing apparatus for electronically 
applying shake correction to sensed image data, and 
5 outputting corrected image data, comprising: 

shake detection means for detecting a shake; 
sampling means capable of sampling shake information 
detected by said shake detection means at a plurality of 
sampling timings within one field period of said image 
10 sensing apparatus ; 

selection means for selecting a shake information 
signal at one of the plurality of sampling timings, which 
corresponds to a drive condition of image sensing means at 
the time of image sensing; 
15 correction data calculation means for calculating a 

shake correction data used in the shake correction by a 
predetermined calculation of the shake information signal 
selected by said selection means; and 

correction means for applying the shake correction to 
20 the sensed image data in accordance with the obtained shake 
correction data . 



2. The apparatus according to claim 1, wherein an 
operation phase of said sampling means is variable within 
25 a sampling interval. 



- 82 - 



3. The apparatus according to claim 1, wherein the 
sampling timing selected by said selection means corresponds 
to a substantially central time in a storage time period of 
the image sensing means . 

5 

4. The apparatus according to claim 1, wherein said 
shake detection means comprises an angular velocity sensor 
for detecting shake angular displacements in two orthogonal 
directions . 

10 

5. The apparatus according to claim 2, wherein said 
sampling means varies the sampling timing in accordance with 
the drive condition of the image sensing means. 

15 6. The apparatus according to claim 5, wherein said 

correction means sets an image data extraction position of 
a temporary storage memory in the image sensing device that 
stores an image signal in correspondence with the shake 
correction data calculated by said correction data 

2 0 calculation means, and outputs image data read out from the 
extraction position as shake-corrected sensed image data. 

7. The apparatus according to claim 1, wherein said 
sampling means comprises: 
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an A/D converter for A/D-converting an output from said 
shake detection means at the plurality of sampling timings 
within one field; and 

an integral circuit for integrating a series of shake 
5 information signals detected at the plurality of sampling 
timings by said A/D converter in units of fields, and 

said selection means selects an integrated signal, 
from a series of integrated signals output from said integral 
circuit, in correspondence with the drive condition of said 
10 image sensing apparatus. 

8. The apparatus according to claim 1, wherein said 
sampling means comprises : 

an A/D converter capable of A/D-converting an output 
15 from said shake detection means at an arbitrary sampling 
timing ; 

means for setting a timing corresponding to the drive 
condition of said image sensing apparatus in said A/D 
converter as a sampling timing; and 
20 means for outputting an output signal from said A/D 

converter to said correction data calculation means. 

9. The apparatus according to claim 1, wherein the 
drive condition includes a shutter speed. 

25 
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10. A shake correction apparatus for correcting a 
shake contained in image data picked up by an external image 
sensing apparatus, comprising: 

shake detection means for detecting a shake ; 
5 sampling means capable of sampling shake information 

detected by said shake detection means at a plurality of 
sampling timings within one field period of said image 
sensing apparatus; 

selection means for selecting a shake information 
10 signal at one of the plurality of sampling timings, which 
corresponds to a drive condition of image sensing means at 
the time of image sensing; 

correction data calculation means for calculating a 
shake correction data used in the shake correction by making 
15 a predetermined calculation of the shake information signal 
selected by said selection means; and 

means for outputting the obtained shake correction 
data to the external image sensing apparatus. 

20 11. The apparatus according to claim 10, wherein said 

sampling means samples the shake information a plurality of 
number of times within a predetermined period, said 
correction data calculation means calculates the shake 
correction data of the plurality of pieces of shake 

25 information, and control means selects the shake correction 
data to be supplied to the image sensing apparatus from the 
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plurality of shake correction datas in accordance with the 
drive condition of the image sensing apparatus. 

12. The apparatus according to claim 10, wherein said 
5 sampling means varies the sampling timing in accordance with 
a change in storage time period of the image sensing 
apparatus . 

13 . The apparatus according to claim 12 , wherein said 
10 sampling means samples an output from said shake detection 
means at a timing corresponding to a substantially central 
time of the storage time period of the image sensing 
apparatus . 

15 14 . A shake correction apparatus for correcting a 

shake contained in image data picked up by external image 
sensing means, comprising: 

shake detection means for detecting a shake; 
sampling means for sampling shake information detected 
20 by said shake detection means at a predetermined timing; 

correction data calculation means for converting the 
shake information sampled by said sampling means into a shake 
correction data by a calculation; 

correction means for correcting a movement of an image 
25 due to the shake at a predetermined cycle on the basis of 
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the calculation result of said correction data calculation 
means ; and 

control means for varying the sampling timing of the 
shake information by said sampling means in accordance with 
5 a drive condition. 

15. The apparatus according to claim 14, wherein said 
sampling means samples the shake information a plurality of 
number of times within a predetermined period, said 

10 correction data calculation means calculates the shake 
correction datas of the plurality of pieces of shake 
information, and said control means selects the shake 
correction data to be supplied to said correction means from 
the plurality of shake correction datas in accordance with 

15 the drive condition. 

16. The apparatus according to claim 15, wherein said 
sampling means samples the shake information used for 
calculating the shake correction data to be supplied to said 

2 0 correction means at a timing corresponding to a substantially 
central time of a storage time period of the image sensing 
means . 

17. The apparatus according to claim 15, wherein said 
25 correction means corrects the shake of the image by moving 
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an image extraction range in a direction to cancel the 
movement of the image due to the shake . 

18. The apparatus according to claim 15, wherein an 
5 exposure condition is a shutter speed. 

19. The apparatus according to claim 15, wherein the 
field period is a generation period of a video signal. 

10 20 . A shake correction method for electronically 

performing shake correction of sensed image data, comprising 
the steps of: 

detecting a shake ; 

acquiring a shake information signal by sampling the 
15 detected shake information at a central timing of a storage 
time period set in correspondence with a drive condition at 
the time of image sensing of image sensing means; 

calculating a shake correction data used in the shake 
correction by a predetermined calculation of the acquired 
20 shake information signal; and 

applying the shake correction to the sensed image data 
in accordance with the obtained shake correction data. 

21. A storage means for storing a control program for 
25 controlling an image sensing apparatus, storing a control 
program that implements a method of claim 20. 
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22. An image sensing apparatus comprising: 
shake detection means for detecting a shake; 
sampling means for sampling shake information detected 

5 by said shake detection means at a predetermined timing; 

correction data calculation means for converting the 
shake information sampled by said sampling means into a shake 
correction data by a calculation; 

read control means for controlling a read timing of 
10 an image sensing device on the basis of a calculation result 
of said correction data calculation means ; and 

sampling timing control means for varying a sampling 
timing of said sampling means in accordance with a drive 
condition of the image sensing device. 

15 

23. The apparatus according to claim 22, wherein the 
sampling point of the shake information is set at a 
substantially central time in a storage time period of the 
image sensing device. 

20 

24. An image sensing apparatus comprising: 
shake detection means for detecting a shake; 
sampling means for sampling shake information detected 

by said shake detection means at a predetermined timing; 
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correction data calculation means for converting the 
shake information sampled by said sampling means into a shake 
correction data by a calculation; 

read control means for controlling a read timing of 
5 an image sensing device on the basis of a calculation result 
of said correction data calculation means ; 

frequency detection means for detecting a frequency 
from the shake information obtained by said shake detection 
means ; and 

10 sampling timing control means for varying a sampling 

timing of said sampling means in correspondence with the 
frequency detected by said frequency detection means. 

25. The apparatus according to claim 24, wherein said 
15 sampling timing control means varies the sampling point of 
the shake information by a time period required for 
correcting frequency response characteristics of said shake 
detection means. 

20 26. The apparatus according to claim 22, wherein said 

shake detection means comprises angular velocity detection 
means . 

27. The apparatus according to claim 24, wherein said 
25 sampling timing control means corrects a frequency response 
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delay of said shake correction means in accordance with, an 
output from said frequency detection means. 

28. A shake correction apparatus comprising: 
5 shake detection means for detecting a shake; 

sampling means for sampling shake information detected 
by said shake detection means at a predetermined timing; 

correction data calculation means for converting the 
shake information sampled by said sampling means into a shake 
10 correction data by a calculation; 

read control means for controlling a read timing of 
an image sensing device on the basis of a calculation result 
of said correction data calculation means ; 

frequency detection means for detecting a frequency 
15 from the shake information obtained by said shake detection 
means ; and 

sampling timing control means for varying a sampling 
timing of said sampling means in accordance with the 
frequency obtained by said frequency detection means . 

20 

29. The apparatus according to claim 28, wherein the 
sampling point of the shake information is varied by a time 
period required for correcting frequency response 
characteristics of said shake detection means . 

25 
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30. The apparatus according to claim 29, wherein said 
shake detection means comprises angular velocity detection 
means . 



5 31. A shake correction method comprising the steps of: 

detecting a shake by shake detection means; 

sampling shake information detected by said shake 
detection means at a predetermined timing; 

converting the sampled shake information into a shake 
10 correction data by a calculation; and 

controlling a read timing of an image sensing device 
on the basis of the calculated shake correction data, and 
varying a sampling timing in the sampling step in accordance 
with a drive condition of the image sensing device. 

15 

32. The method according to claim 31, wherein the 
sampling point of the shake information is set at a 
substantially central time in a storage time period of the 
image sensing device. 

20 

33 . A shake correction method comprising the steps of: 
detecting a shake by shake detection means; 
sampling shake information detected by said shake 
detection means at a predetermined timing ; 
25 converting the sampled shake information into a shake 

correction data by a calculation; 
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detecting a shake frequency from the shake 
information; and 

controlling a read timing of an image sensing device 
on the basis of the calculated shake correction data, and 
5 varying a sampling timing in the sampling step in accordance 
with the shake frequency. 

34. A shake correction method comprising the steps of: 
detecting a shake by shake detection means; 

10 sampling the detected shake information at a 

predetermined timing ; 

converting the sampled shake information into a shake 
correction data by a calculation; 

detecting a shake frequency from the shake 
15 information; and 

controlling a read timing of an image sensing device 
on the basis of the calculated shake correction data, and 
varying a sampling timing in the sampling step in accordance 
with the shake frequency. 

20 

35. The method according to claim 33, wherein the 
sampling point of the shake information is varied by a time 
period required for correcting frequency response 
characteristics of said shake detection means. 

25 

36. An image sensing method comprising: 
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the shake detection step of detecting a shake; 

the sampling step of sampling shake information 
detected in the shake detection step at a plurality of 
predetermined even timings during one video period; 
5 the shake correction data calculation step of 

converting the shake information sampled in the sampling step 
into a shake correction data by calculations at uneven 
timings in correspondence with the number of times of 
sampling; and 

10 the shake correction step of correcting a shake of an 

image sensing apparatus main body on the basis of a 
calculation result in the shake correction data calculation 
step . 

15 37 . The method according to claim 36 , wherein the shake 

correction data calculation step has the read control step 
of controlling a read timing of an image sensing device 
provided to the image sensing apparatus main body on the basis 
of the calculation result by itself. 

20 

38. The method according to claim 36, wherein a sensor 
used in the shake detection step is an angular velocity 
sensor . 

25 39. An image sensing apparatus comprising: 

shake detection means for detecting a shake ; 
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sampling means for sampling shake information detected 
by said shake detection means at a plurality of predetermined 
even timings during one video period ; 

shake correction data calculation means for converting 
5 the shake information sampled by said sampling means into 
a shake correction data by calculations at uneven timings 
in correspondence with the number of times of sampling; and 

shake correction means for correcting a shake of an 
image sensing apparatus main body on the basis of a 
10 calculation result of said shake correction data calculation 
means . 

40 . The apparatus according to claim 39 , wherein shake 
correction data calculation means has read control means for 
15 controlling a read timing of an image sensing device provided 
to the image sensing apparatus main body on the basis of the 
calculation result by itself. 

41. The apparatus according to claim 39, wherein said 
20 shake detection means comprises an angular velocity sensor. 

42 . A storage medium that stores a control program for 
controlling an image sensing apparatus, said control program 
having control modules of the steps of : 
25 detecting a shake of an image sensing apparatus main 

body ; 
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sampling the detected shake information at a plurality 
of predetermined even timings during one video period ; 

converting the sampled shake information into a shake 
correction data by calculation at uneven timings in 
5 correspondence with the number of times of sampling; and 

correcting the shake of the image sensing apparatus 
main body on the basis of a calculation result of the shake 
correction data. 

10 43. The medium according to claim 42, wherein said 

control program has a control module of the step of 
controlling a read timing of an image sensing device provided 
to the image sensing apparatus main body on the basis of the 
shake correction data calculation result. 

15 

44. An image sensing method comprising: 
the shake detection step of detecting a shake; 
the sampling step of sampling shake information 
detected in the shake detection step at a plurality of 
20 predetermined timings during one video period; 

the correction data calculation step of converting the 
shake information into a shake correction data by a 
calculation on the basis of sampling operation in the 
sampling step; 
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the read control step of controlling a read timing of 
an image sensing device on the basis of a calculation result 
in the correction data calculation step; 

the correction data determination step of selectively 
5 determining the shake correction data calculated in the 
correction data calculation step at different timings 
depending on a drive condition of the image sensing device, 
and supplying the determined shake correction data to the 
read control step; and 
10 the phase correction step of correcting a phase of a 

signal that pertains to the shake on the basis of the drive 
condition of the image sensing device. 

45. An image sensing method comprising: 
15 the shake detection step of detecting a shake; 

the sampling step of sampling shake information 
detected in the shake detection step at a plurality of 
predetermined timings during one video period; 

the correction data calculation step of converting the 
20 shake information into a shake correction data by a 

calculation on the basis of sampling operation in the 
sampling step; 

the shake frequency detection step of detecting a shake 
frequency on the basis of the shake information detected in 
25 the shake detection step; 



the first phase correction step of correcting a phase 
of a signal that pertains to the shake on the basis of the 
shake frequency detected in the shake frequency detection 
step; 

5 the read control step of controlling a read timing of 

an image sensing device on the basis of a calculation result 
in the correction data calculation step; 

the correction data determination step of selectively 
determining the shake correction data calculated in the 
10 correction data calculation step at different timings 

depending on a drive condition of the image sensing device, 
and supplying the determined shake correction data to the 
read control step; and 

the second phase correction step of correcting the 
15 phase of the signal that pertains to the shake on the basis 
of the drive condition of the image sensing device and the 
shake frequency detected in the shake frequency detection 
step . 

20 46. An image sensing method comprising: 

the shake detection step of detecting a shake ; 
the sampling step of sampling shake information 
detected in the shake detection step at a plurality of 
predetermined timings during one video period; 
25 the correction data calculation step of converting the 

shake information into a shake correction data by a 



calculation on the basis of sampling operation in the 
sampling step; 

the read control step of controlling a read timing of 
an image sensing device on the basis of a calculation result 
5 in the correction data calculation step; 

the correction data determination step of selectively 
determining the shake correction data calculated in the 
correction data calculation step at different timings 
depending on a drive condition of the image sensing device, 
10 and supplying the determined shake correction data to the 
read control step; 

the shake frequency detection step of detecting a shake 
frequency on the basis of the shake information detected in 
the shake detection step; and 
15 the phase correction step of correcting a phase of a 

signal that pertains to the shake on the basis of a drive 
condition of the image sensing device and the shake frequency 
detected in the shake frequency detection step. 

20 47 . The method according to claim 44 , wherein the drive 

condition of the image sensing device is a condition for 
defining drive operation for varying an actual storage time 
period of the image sensing device. 

25 48 . The method according to claim 45 , wherein the drive 

condition of the image sensing device is a condition for 
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defining drive operation for varying an actual storage time 
period of the image sensing device. 

49 . The method according to claim 46 , wherein the drive 
5 condition of the image sensing device is a condition for 
defining drive operation for varying an actual storage time 
period of the image sensing device. 

50. The method according to claim 44, wherein the 
10 signal that pertains to the shake is a shake signal. 

51. The method according to claim 45, wherein the 
signal that pertains to the shake is a shake signal. 

15 52. The method according to claim 46, wherein the 

signal that pertains to the shake is a shake signal. 

53. The method according to claim 44, wherein the 
signal that pertains to the shake is a shake correction 

20 signal. 

54. The method according to claim 45, wherein the 
signal that pertains to the shake is a shake correction 
signal . 

25 



- 100 - 



55. The method according to claim 46, wherein the 
signal that pertains to the shake is a shake correction 
signal . 



5 56 . The method according to claim 44 , wherein the drive 

condition of the image sensing device is a selection timing 
in the correction data determination step. 

57 . The method according to claim 45 , wherein the drive 
10 condition of the image sensing device is a selection timing 

in the correction data determination step. 

58 . The method according to claim 46 , wherein the drive 
condition of the image sensing device is a selection timing 

15 in the correction data determination step. 

59. An image sensing apparatus comprising: 
shake detection means for detecting a shake; 
sampling means for sampling shake information detected 
20 by said shake detection means at a plurality of predetermined 
timings during one video period ; 

correction data calculation means for converting the 
shake information into a shake correction data by a 
calculation on the basis of sampling operation of said 
25 sampling means; 
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read control means for controlling a read timing of 
an image sensing device on the basis of a calculation result 
of said correction data calculation means ; 

correction data determination means for selectively 
5 determining the shake correction data calculated by said 
correction data calculation means at different timings 
depending on a drive condition of the image sensing device, 
and supplying the determined shake correction data to said 
read control means; and 
10 phase correction means for correcting a phase of a 

signal that pertains to the shake on the basis of the drive 
condition of the image sensing device. 

60. An image sensing apparatus comprising: 
15 shake detection means for detecting a shake ; 

sampling means for sampling shake information detected 
by said shake detection means at a plurality of predetermined 
timings during one video period; 

correction data calculation means for converting the 
20 shake information into a shake correction data by a 

calculation on the basis of sampling operation of said 
sampling means; 

shake frequency detection means for detecting a shake 
frequency on the basis of the shake information detected by 
25 said shake detection means ; 
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first phase correction means for correcting a phase 
of a signal that pertains to the shake on the basis of the 
shake frequency detected by said shake frequency detection 
means ; 

5 read control means for controlling a read timing of 

an image sensing device on the basis of a calculation result 
of said correction data calculation means; 

correction data determination means for selectively 
determining the shake correction data calculated by said 
10 correction data calculation means at different timings 

depending on a drive condition of the image sensing device, 
and supplying the determined shake correction data to said 
read control means; and 

second phase correction means for correcting the phase 
15 of the signal that pertains to the shake on the basis of the 
drive condition of the image sensing device and the shake 
frequency detected by said shake frequency detection means. 



61. An image sensing apparatus comprising: 
20 shake detection means for detecting a shakes- 

sampling means for sampling shake information detected 
by said shake detection means at a plurality of predetermined 
timings during one video periods- 
correction data calculation means for converting the 
25 shake information into a shake correction data by a 
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calculation on the basis of sampling operation of said 
sampling means ; 

read control means for controlling a read timing of 
an image sensing device on the basis of a calculation result 
5 of said correction data calculation means ; 

correction data determination means for selectively 
determining the shake correction data calculated by said 
correction data calculation means at different timings 
depending on a drive condition of the image sensing device, 
10 and supplying the determined shake correction data to said 
read control means ; 

shake frequency detection means for detecting a shake 
frequency on the basis of the shake information detected by 
said shake detection means; and 
15 phase correction means for correcting a phase of a 

signal that pertains to the shake on the basis of a drive 
condition of the image sensing device and the shake frequency 
detected by said shake frequency detection means. 

20 62. The apparatus according to claim 59, wherein the 

drive condition of the image sensing device is a condition 
for defining drive operation for varying an actual storage 
time period of the image sensing device. 

25 63. The apparatus according to claim 60, wherein the 

drive condition of the image sensing device is a condition 
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for defining drive operation for varying an actual storage 
time period of the image sensing device. 



64. The apparatus according to claim 61, wherein the 
5 drive condition of the image sensing device is a condition 
for defining drive operation for varying an actual storage 
time period of the image sensing device. 



65 . The apparatus according to claim 59 , wherein the 
10 signal that pertains to the shake is a shake signal. 



66. The apparatus according to claim 60, wherein the 
signal that pertains to the shake is a shake signal. 

15 67. The apparatus according to claim 61, wherein the 

signal that pertains to the shake is a shake signal. 



68. The apparatus according to claim 59, wherein the 
signal that pertains to the shake is a shake correction 
20 s ignal . 



69. The apparatus according to claim 60, wherein the 
signal that pertains to the shake is a shake correction 
signal . 

25 
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70. The apparatus according to claim 61 
signal that pertains to the shake is a shake 
s ignal . 



, wherein the 
correction 



5 71. The apparatus according to claim 59, wherein said 

image sensing apparatus is a video camera. 

72. The apparatus according to claim 60, wherein said 
image sensing apparatus is a video camera. 

10 

73. The apparatus according to claim 61, wherein said 
image sensing apparatus is a video camera. 

74. The apparatus according to claim 59, wherein the 
15 drive condition of the image sensing device is a selection 

timing of said correction data determination means . 

75. A storage medium storing a control program that 
implements an image sensing method of claim 44 to control 

20 an image sensing apparatus. 

76. A storage medium storing a control program that 
implements an image sensing method of claim 45 to control 
an image sensing apparatus. 

25 
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77 . A storage medium storing a control program that 
implements an image sensing method of claim 46 to control 
an image sensing apparatus. 
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ABSTRACT OF THE DISCLOSURE 



There is disclosed a shake prevention apparatus for 
compensating for a disturbance in an image resulting from 
a camera shake. A shake of a camera main body is measured 
by a gyro sensor. Upon sampling the output signal from the 
sensor by an A/D converter, a sampling timing corresponding 
to a shutter speed is set. Especially, a timing is generated 
so that the sampling timing corresponds to the central 
position of the charge storage period of a CCD. 
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